Adaptive control of MDPs

As a final case study, we consider the problem of adaptive control. We have already considered the problem of estimating regret when the MCM π is unknown but can be estimated by πˆ. Specifically, we have considered the problemof replacingπwith a single statistical estimate πˆ, and the problem of employing successively refined numerical estimates of a known model π.