This book is an introduction to the modern theory of Markov chains, whose goal is to determine the rate of convergence to the stationary distribution, as a function of state space size and geometry. This topic has important ...

Buy Now From Amazon

This book is an introduction to the modern theory of Markov chains, whose goal is to determine the rate of convergence to the stationary distribution, as a function of state space size and geometry. This topic has important connections to combinatorics, statistical physics, and theoretical computer science. Many of the techniques presented originate in these disciplines.The central tools for estimating convergence times, including coupling, strong stationary times, and spectral methods, are developed. The authors discuss many examples, including card shuffling and the Ising model, from statistical mechanics, and present the connection of random walks to electrical networks and apply it to estimate hitting and cover times.The first edition has been used in courses in mathematics and computer science departments of numerous universities. The second edition features three new chapters (on monotone chains, the exclusion process, and stationary times) and also includes smaller additions and corrections throughout. Updated notes at the end of each chapter inform the reader of recent research developments.

Similar Products

High-Dimensional Probability: An Introduction with Applications in Data Science (Cambridge Series in Statistical and Probabilistic Mathematics)High-Dimensional Statistics: A Non-Asymptotic Viewpoint (Cambridge Series in Statistical and Probabilistic Mathematics)Reinforcement Learning: An Introduction (Adaptive Computation and Machine Learning series)Probability on Trees and Networks (Cambridge Series in Statistical and Probabilistic Mathematics)Concentration Inequalities: A Nonasymptotic Theory of IndependenceProbability with Martingales (Cambridge Mathematical Textbooks)Large Networks and Graph Limits (Colloquium Publications) (American Mathematical Society Colloquium Publications)Deep Learning (Adaptive Computation and Machine Learning series)