Topics: Markov Chain - Transition Probabilities in a Markov Chain


The usual transition probabilities in a Markov chain are actually conditional in the sense that they consider a specific present state. For instance, in the case of one step transition probabilities, they are .

If we want to obtain the unconditional transition probabilities, then we can use the initial probability vector to calculate: