Markov chains; Stationary distributions of a markov chain; Markov pure jump processes; Second order processes; Continuity, integration, and differentiation of second order processes; Stochastic differential equations, estimation theory, and spectral distribution.