ABSTRACT
In this chapter, we study Markov chains whose state space is countably innite.Wewillrefertotheseascountablechains.Manyoftheresultsfrom thenite-statecaseremainvalid,butnotall.OneexampleofthedifferencesisthattheMarkovchaincanconsistentirelyoftransientstatesasthe following example shows.
