"Preface. Latent Markov models represent an important class of latent variable models for the analysis of longitudinal data, when the response variables measure common characteristics of interest which are not directly observable. Typically, the response variables are categorica…
Drawing on the authors' extensive research in the analysis of categorical longitudinal data, Latent Markov Models for Longitudinal Data focuses on the formulation of latent Markov models and the practical use of these models. Numerous examples illustrate how latent Markov models…
Markov Decision Processes with Applications to Finance
by Bäuerle, Nicole, Rieder, Ulrich
fromUniversitext
The theory of Markov decision processes focuses on controlled Markov chains in discrete time. The authors establish the theory for general state and action spaces and at the same time show its application by means of numerous examples, mostly taken from the fields of finance and…
"This book presents up-to-date research developments and novel methodologies on semi-Markovian jump systems (S-MJS). It presents solutions to a series of problems with new approaches for the control and filtering of S-MJS, including stability analysis, sliding mode control, dyna…
The historical process is constructed to be a superprocess which is enriched so as to contain information on genealogy. This process together with a representation for the associated Palm measures are used to describe the modulus of continuity and equilibrium structure for a cla…