ABSTRACT
In discrete-time Markov chains, a change of state could occur only at specic pointsintime.Forcontinuous-timeMarkovchains,achangeofstatecan occuratanytime.Weagainonlyconsiderprocessesthatarehomogeneous intime.Thestatespaceiscountable(here,thisincludesnite),andtherewill be some differences between thenite and innite state cases.
