"Markov processes are among the most important stochastic processes for both theory and applications. This book develops the general theory of these processes and applies this theory to various special examples. The initial chapter is devoted to the most important classical exam…