ABSTRACT
Certain complex systems exhibit characteristics that evolve randomly over time. A Markov process is a mathematical model, based on principles developed by the Russian probability theorist A. A. Markov, that allows systems engineers and analysts to describe and predict the behavior of such systems. Probabilities and uncertainties arise in the most diverse applications, and in many cases, Markov analysis provides a framework in which to study the behavior of these systems.
