ABSTRACT
Concepts and properties of Markov chains are presented in this chapter, which is followed by a powerful, simple and popular implementation of stochastic simulation via Markov Chain Monte Carlo (MCMC) methods, namely, the Metropolis-Hastings algorithm. Some practical aspects and speedup techniques for the implementation of MCMC methods are addressed in this chapter, which also includes elements for the analysis of the Markov chains.
