ABSTRACT
Markov chains describe random changes in a system of discrete states over time,
such that the future depends on the present but not the past. This independence of
the future from the past, given the present state, is known as the Markov property
after the Russian mathematician Andrei Andreevich Markov (1856-1922) who
made a systematic study of such sequences.
