All results given in this chapter are derived from results presented in Nummelin (1984) and Meyn and Tweedie (1993). Many of these results are given in Tierney (1994) with proofs or references to proofs. To simplify the presentation, no proofs are provided in this chapter, and references are

given for results not directly available in these sources.