Hidden Markov Model Processing.- Discrete-Time HMM Estimation.- Discrete States and Discrete Observations.- Continuous-Range Observations.- Continuous-Range States and Observations.- A General Recursive Filter.- Practical Recursive Filters.- Continuous-Time HMM Estimation.- Discrete-Range States and Observations.- Markov Chains in Brownian Motion.- Two-Dimensional HMM Estimation.- Hidden Markov Random Fields.- HMM Optimal Control.- Discrete-Time HMM Control.- Risk-Sensitive Control of HMM.- Continuous-Time HMM Control.
Preface.- Part I Introduction: 1.Hidden Markov Model Processing.- Part II Discrete-Time HMM Estimation: 2.Discrete States and Discrete Observations.- 3.Continuous-Range Observations.- 4.Continuous-Range States and Observations.- 5.A General Recursive Filter.- 6.Practical Recursive Filters.- Part III Continuous-Time HMM Estimation: 7.Discrete-Range States and Observations.- 8.Markov Chains in Brownian Motion .- Part IV Two-Dimensional HMM Estimation: 9.Hidden Markov Random Fields.- Part V HMM Optimal Control: 10.Discrete-Time HMM Control.- 11.Risk-Sensitive Control of HMM.- 12.Continuous-Time HMM Control.- Appendices: A.Basic Probability Concepts.- B.Continuous-Time Martingale Representation. -References.- Index.
As more applications are found, interest in Hidden Markov Models continues to grow. Following comments and feedback from colleagues, students and other working with Hidden Markov Models the corrected 3rd printing of this volume contains clarifications, improvements and some new material, including results on smoothing for linear Gaussian dynamics.
In Chapter 2 the derivation of the basic filters related to the Markov chain are each presented explicitly, rather than as special cases of one general filter. Furthermore, equations for smoothed estimates are given. The dynamics for the Kalman filter are derived as special cases of the authors' general results and new expressions for a Kalman smoother are given. The Chapters on the control of Hidden Markov Chains are expanded and clarified. The revised Chapter 4 includes state estimation for discrete time Markov processes and Chapter 12 has a new section on robust control.
Corrected second printing