Stochastic processes

• How to Calculate Probabilities in a Markov Chain
  Calculate Markov-chain probabilities using transition matrices, initial distributions, matrix powers, path products, and hitting-probability equations.
• How to Find the Expected Squared Distance in a Random Walk
  For a random walk on a graph, calculate expected squared distance by weighting each squared graph distance by the probability of reaching that vertex.