MATLAB

• Available on computers in IEOR Computer Lab, 301 Mudd

  an online tutorial

Markov Chain Tools

• Examples of transition matrices constructed in MATLAB:

  • two-state example (in PDF)

  • six-state example (in PDF)

  • magic-square example (in PDF)

    (doubly stochastic example)

  • five-state example (in PDF)

    (classifying states)

  • seven-state example (in PDF)

    (classifying states)

• Markov Chain Programs and Data for MATLAB:

  • (stationary) Markov Mouse Example (PDF) (See Class Lecture Notes for 2/3.)

    Markov Mouse data (to use as input to MATLAB using load command)

    stationary vector MATLAB programs: stat.m (PDF version) and stationary.m (PDF version)

    Escaping Mouse Example(PDF)

    Escaping Mouse Q data (to use as input to MATLAB)

    Escaping Mouse R data (to use as input to MATLAB)

    absorbing Markov chain MATLAB program: absorbing.m (PDF version)

    six-state periodic chain example (PDF)

    data for six-state periodic example (to use as input to MATLAB)