Topics: Markov Chain - Stochastic Process


(definition)

In the context of a Markov chain, the recurrence time is the minimum amount of steps that are needed to go back to a given state for the first time.

Compare the first-passage time, which refers to the minimum amount of steps that are needed to get to a state (for the first time, too).

The recurrence time to a state , denoted (similarly to a first-passage time), is given by:

…where is the steady state probability of .