Timezone: »

 
Multi-Agent Policy Transfer via Task Relationship Modeling
Rong-Jun Qin · Feng Chen · Tonghan Wang · Lei Yuan · Xiaoran Wu · Yipeng Kang · Zongzhang Zhang · Chongjie Zhang · Yang Yu

@
in Deep Reinforcement Learning Workshop »
Event URL: https://openreview.net/forum?id=5pWNx-LZ8D »

Team adaptation to new cooperative tasks is a hallmark of human intelligence, which has yet to be fully realized in learning agents. Previous works on multi-agent transfer learning accommodate teams of different sizes, but heavily rely on the generalization ability of neural networks for adapting to unseen tasks. We posit that the relationship among tasks provides the key information for policy adaptation. To utilize such relationship for efficient transfer, we try to discover and exploit the knowledge among tasks from different teams, propose to learn effect-based task representations as a common latent space among tasks, and use it to build an alternatively fixed training scheme. We demonstrate that the task representation can capture the relationship among teams and generalize to unseen tasks. As a result, the proposed method can help transfer learned cooperation knowledge to new tasks after training on a few source tasks, and the learned transferred policies can also help solve tasks that are hard to learn from scratch.

[ Poster]  [ OpenReview]  [ Topia] 

Author Information

Rong-Jun Qin (Nanjing University)
Feng Chen (Nanjing University)
Tonghan Wang (Tsinghua University)

Tonghan Wang is currently a Master student working with Prof. Chongjie Zhang at Institute for Interdisciplinary Information Sciences, Tsinghua University, headed by Prof. Andrew Yao. His primary research goal is to develop innovative models and methods to enable effective multi-agent cooperation, allowing a group of individuals to explore, communicate, and accomplish tasks of higher complexity. His research interests include multi-agent learning, reasoning under uncertainty, reinforcement learning, and representation learning in multi-agent systems.

Lei Yuan (None)
Xiaoran Wu (Tsinghua University)
Yipeng Kang (Tsinghua University)
Zongzhang Zhang (Nanjing University)
Zongzhang Zhang

I am now an associate professor at the School of Artificial Intelligence, Nanjing University.

Chongjie Zhang (Tsinghua University)
Yang Yu (Nanjing University)

More from the Same Authors