Preface 1 Probability Review 2 Discrete Time Markov Models 3 Recurrence and Ergodicity 4 Long Run Behavior 5 Lyapunov Functions and Martingales 6 Eigenvalues and Nonhomogeneous Markov Chains 7 Gibbs Fields and Monte Carlo Simulation 8 Continuous-Time Markov Models 9 Poisson Calculus and Queues Appendix Bibliography Author Index Subject Index
Preface * 1 Probability Review * 2 Discrete Time Markov Models * 3 Recurrence and Ergodicity * 4 Long Run Behavior * 5 Lyapunov Functions and Martingales * 6 Eigenvalues and Nonhomogeneous Markov Chains * 7 Gibbs Fields and Monte Carlo Simulation * 8 Continuous-Time Markov Models 9 Poisson Calculus and Queues * Appendix * Bibliography * Author Index * Subject Index
Primarily an introduction to the theory of stochastic processes at the undergraduate or beginning graduate level, the primary objective of this book is to initiate students in the art of stochastic modelling. However it is motivated by significant applications and progressively brings the student to the borders of contemporary research. Examples are from a wide range of domains, including operations research and electrical engineering. Researchers and students in these areas as well as in physics, biology and the social sciences will find this book of interest.
This text is an introduction to the theory of stochastic processes at the undergraduate or beginning graduate level. Its primary objective is to initiate the student to the art of stochastic modeling. Mathematical definitions, theorems, proofs, and a number of classroom examples help the student to fully grasp the content of the main results, and problems of varying difficulty are proposed at the end of each chapter. The material is accessible to students who know the basics of probability theory, but a review of probability is included to make the text largely self-contained. It brings students to the borders of current research covering more advanced topics such as Martingales, eigenvalue, Gibbs fields and Monte Carlo techniques.