Timezone: »

Regret Minimization in Games with Incomplete Information
Martin A Zinkevich · Michael Johanson · Michael Bowling · Carmelo Piccione

Mon Dec 03 08:10 PM -- 08:25 PM (PST) @

Extensive games are a powerful model of multiagent decision-making scenarios with incomplete information. Finding a Nash equilibrium for very large instances of these games has received a great deal of recent attention. In this paper, we describe a new technique for solving large games based on regret minimization. In particular, we introduce the notion of counterfactual regret, which exploits the degree of incomplete information in an extensive game. We show how minimizing counterfactual regret minimizes overall regret, and therefore in self-play can be used to compute a Nash equilibrium. We demonstrate this technique in the domain of poker, showing we can solve abstractions of limit Texas Hold'em with as many as 10^12 states, two orders of magnitude larger than previous methods.

Author Information

Martin A Zinkevich (Yahoo! Inc.)
Michael Johanson (University of Alberta)
Michael Bowling (DeepMind / University of Alberta)
Carmelo Piccione (University of Alberta)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors