Topics: Stochastic Process


(definition)

Given a stochastic process with possible states, we can define an initial probability vector :

…where denotes the probability of the initial state being .