Controlled Markov Chains

The significance of any definition, of course, resides in its consequences and applications, and so we turn to such questions in the next chapters which are dedicated to adaptive control of finite Markov chains [1-3].