Discrete-time dynamics

Here we record the discrete-time version of the master equation described earlier. We follow Costantini and Garibaldi (1999) in the derivation.

Given a discrete-time Markov chain with state vector {s(t), t = 0, 1, 2,...}, it satisfies

and the entry probability