Partially Observed Markov Decision Processes

This survey of formulation, algorithms, and structural results in POMDPs focuses on underlying concepts and connections to real-world applications in controlled sensing, keeping technical machinery to a minimum. The new edition includes inverse reinforcement learning, non-parametric Bayesian inference, variational Bayes and conformal prediction.