202. Markov Chains

202.1. Checkout Counter Model




Where:

202.2. -Step Transition Probabilities

State occupance probabilities given initial state :

202.3. Key Recursion

The total probability of ending at with state is the sum of probabilities of the different paths to get to state

202.4. Random Initial State