Prerequisites from the Theory of Stochastic Processes and Stochastic Dynamic Optimization.- Local Control of Discrete Time Interacting Markov Processes with Graph Structured State Space.- Sequential Stochastic Games with Distributed Players on Graphs.- Local Control of Continuous Time Interacting Markov and Semi-Markov Processes with Graph Structured State Space.- Connections with Optimization of Random Field in Different Areas.

This book is devoted to the study and optimization of spatiotemporal stochastic processes - processes which develop simultaneously in space and time under random influences. These processes are seen to occur almost everywhere when studying the global behavior of complex systems. The book presents problems and content not considered in other books on controlled Markov processes, especially regarding controlled Markov fields on graphs.