Discrete time, finite state space mean field games

Abstract

In this paper we report on some recent results for mean field models in discrete time with a finite number of states. These models arise in situations that involve a very large number of agents moving from state to state according to certain optimality criteria. The mean field approach for optimal control and differential games (continuous state and time) was introduced by Lasry and Lions (C. R. Math. Acad. Sci. Paris, 343(9):619–625, 2006; 343(10):679–684, 2006; Jpn. J. Math., 2(1):229–260, 2007). The discrete time, finite state space setting is motivated both by its independent interest as well as by numerical analysis questions which appear in the discretization of the problems introduced by Lasry and Lions. We address existence, uniqueness and exponential convergence to equilibrium results.