Timezone: »

 
Poster
End-to-End Learning and Intervention in Games
Jiayang Li · Jing Yu · Yu Nie · Zhaoran Wang

Tue Dec 08 09:00 AM -- 11:00 AM (PST) @ Poster Session 1 #189
in Poster Session 2 »

In a social system, the self-interest of agents can be detrimental to the collective good, sometimes leading to social dilemmas. To resolve such a conflict, a central designer may intervene by either redesigning the system or incentivizing the agents to change their behaviors. To be effective, the designer must anticipate how the agents react to the intervention, which is dictated by their often unknown payoff functions. Therefore, learning about the agents is a prerequisite for intervention. In this paper, we provide a unified framework for learning and intervention in games. We cast the equilibria of games as individual layers and integrate them into an end-to-end optimization framework. To enable the backward propagation through the equilibria of games, we propose two approaches, respectively based on explicit and implicit differentiation. Specifically, we cast the equilibria as the solutions to variational inequalities (VIs). The explicit approach unrolls the projection method for solving VIs, while the implicit approach exploits the sensitivity of the solutions to VIs. At the core of both approaches is the differentiation through a projection operator. Moreover, we establish the correctness of both approaches and identify the conditions under which one approach is more desirable than the other. The analytical results are validated using several real-world problems.

Author Information

Jiayang Li (Northwestern University)
Jing Yu (Northwestern University)
Yu Nie (Northwestern University)
Zhaoran Wang (Northwestern University)

More from the Same Authors