D The Principle of Optimality in Stochastic Processes

The objective of this appendix is to examine an argument against Bellman’s Principle of Optimality, allegedly showing that the principle runs into trouble in the context of stochastic processes with non-denumerable state spaces. I show that the alleged difficulty does not arise if one’s reading of the principle remains true to Bellman’s understanding thereof.