ABSTRACT
In what follows, we will show that the adaptive control problem of ergodic and general type Markov chains should be formulated in an absolutely different manner:
if in the ergodic case this problem can be formulated as an optimization problem, in the case of general type chains the adaptive control problem turns out to be equivalent to an inequality type problem.
