Handbook of Markov Decision Processes : Methods and Applications (International Series in Operations Research & Management Science) (Reprint)

1.1 AN OVERVIEW OF MARKOV DECISION PROCESSES The theory of Markov Decision Processes-also known under several other names including sequential stochastic optimization, discrete-time stochastic control, and stochastic dynamic programming-studiessequential optimization ofdiscrete time stochastic systems.