Finite Markov chains/
John G. Kemeny and J. Laurie Snell
- New York: Springer-Verlag, 1976.
- ix, 210 p. ; 24 cm.
- (Undergraduate texts in mathematics) .
Prerequisites -- Basic concepts of Markov chains -- Absorbing Markov chains -- Regular Markov chains -- Ergodic Markov chains -- Further results -- Applications of Markov chains -- Appendix I. Summary of basic notation -- Appendix II. Basic definitions -- Appendix III. Basic quantities for absorbing chains -- Appendix IV. Basic formulas for absorbing chains -- Appendix V. Basic quantities for Ergodic chains -- Appendix VI. Basic formulas for Ergodic chains.