Topics: Stochastic Process
(definition)
Given a stochastic process with possible states, we can define an initial probability vector :
…where denotes the probability of the initial state being .
Example
For instance, let’s say we have the stochastic process of tossing a coin and noting when we get heads or when we get tails. This process has a simple state set of .
The initial probability vector of this process is , since the probability of getting either heads or tails is .