[PDF] Zero Sum Discrete Time Markov Games With Unknown Disturbance Distribution eBook

Author : J. Adolfo Minjárez-Sosa
Publisher : Springer Nature
Page : 129 pages
File Size : 40,77 MB
Release : 2020-01-27
Category : Mathematics
ISBN : 3030357201

GET BOOK

This SpringerBrief deals with a class of discrete-time zero-sum Markov games with Borel state and action spaces, and possibly unbounded payoffs, under discounted and average criteria, whose state process evolves according to a stochastic difference equation. The corresponding disturbance process is an observable sequence of independent and identically distributed random variables with unknown distribution for both players. Unlike the standard case, the game is played over an infinite horizon evolving as follows. At each stage, once the players have observed the state of the game, and before choosing the actions, players 1 and 2 implement a statistical estimation process to obtain estimates of the unknown distribution. Then, independently, the players adapt their decisions to such estimators to select their actions and construct their strategies. This book presents a systematic analysis on recent developments in this kind of games. Specifically, the theoretical foundations on the procedures combining statistical estimation and control techniques for the construction of strategies of the players are introduced, with illustrative examples. In this sense, the book is an essential reference for theoretical and applied researchers in the fields of stochastic control and game theory, and their applications.

Author : Alexey Piunovskiy
Publisher : Springer Nature
Page : 356 pages
File Size : 46,60 MB
Release : 2021-06-04
Category : Technology & Engineering
ISBN : 3030769283

GET BOOK

This book presents state-of-the-art solution methods and applications of stochastic optimal control. It is a collection of extended papers discussed at the traditional Liverpool workshop on controlled stochastic processes with participants from both the east and the west. New problems are formulated, and progresses of ongoing research are reported. Topics covered in this book include theoretical results and numerical methods for Markov and semi-Markov decision processes, optimal stopping of Markov processes, stochastic games, problems with partial information, optimal filtering, robust control, Q-learning, and self-organizing algorithms. Real-life case studies and applications, e.g., queueing systems, forest management, control of water resources, marketing science, and healthcare, are presented. Scientific researchers and postgraduate students interested in stochastic optimal control,- as well as practitioners will find this book appealing and a valuable reference. ​

Author : Daniel Hernández‐Hernández
Publisher : Springer Nature
Page : 178 pages
File Size : 15,62 MB
Release : 2021-11-14
Category : Mathematics
ISBN : 303085325X

GET BOOK

This volume contains papers which were presented at the XV Latin American Congress of Probability and Mathematical Statistics (CLAPEM) in December 2019 in Mérida-Yucatán, México. They represent well the wide set of topics on probability and statistics that was covered at this congress, and their high quality and variety illustrates the rich academic program of the conference.

Author : Tomás Prieto-Rumeau
Publisher : World Scientific
Page : 292 pages
File Size : 26,14 MB
Release : 2012
Category : Mathematics
ISBN : 1848168489

GET BOOK

This book concerns continuous-time controlled Markov chains, also known as continuous-time Markov decision processes. They form a class of stochastic control problems in which a single decision-maker wishes to optimize a given objective function. This book is also concerned with Markov games, where two decision-makers (or players) try to optimize their own objective function. Both decision-making processes appear in a large number of applications in economics, operations research, engineering, and computer science, among other areas.An extensive, self-contained, up-to-date analysis of basic optimality criteria (such as discounted and average reward), and advanced optimality criteria (e.g., bias, overtaking, sensitive discount, and Blackwell optimality) is presented. A particular emphasis is made on the application of the results herein: algorithmic and computational issues are discussed, and applications to population models and epidemic processes are shown.This book is addressed to students and researchers in the fields of stochastic control and stochastic games. Moreover, it could be of interest also to undergraduate and beginning graduate students because the reader is not supposed to have a high mathematical background: a working knowledge of calculus, linear algebra, probability, and continuous-time Markov chains should suffice to understand the contents of the book.

Author : Institute of Electrical and Electronics Engineers
Publisher :
Page : 1462 pages
File Size : 13,36 MB
Release : 1997
Category : Electric engineering
ISBN :

GET BOOK

Issues for 1973- cover the entire IEEE technical literature.

Author : Peter Vrancx
Publisher : ASP / VUBPRESS / UPA
Page : 218 pages
File Size : 10,34 MB
Release : 2011
Category : Computers
ISBN : 9054877154

GET BOOK

Introducing a new approach to multiagent reinforcement learning and distributed artificial intelligence, this guide shows how classical game theory can be used to compose basic learning units. This approach to creating agents has the advantage of leading to powerful, yet intuitively simple, algorithms that can be analyzed. The setup is demonstrated here in a number of different settings, with a detailed analysis of agent learning behaviors provided for each. A review of required background materials from game theory and reinforcement learning is also provided, along with an overview of related multiagent learning methods.