chapter  10
40 Pages

Markov Chains

All the processes we have considered so far have been based on sequences of independent equidistributed random variables. We now consider processes which are based on sequences of dependent random variables but for which the dependence is of the simplest possible kind: the future depends on the present but not on the past.