Timezone: »

 
Workshop
Emergent Communication Workshop
Jakob Foerster · Angeliki Lazaridou · Ryan Lowe · Igor Mordatch · Douwe Kiela · Kyunghyun Cho

Sat Dec 08 05:00 AM -- 03:30 PM (PST) @ Room 524

Abstract
Communication is one of the most impressive human abilities. The question of how communication arises has been studied for many decades, if not centuries. However, due to computational and representational limitations, past work was restricted to low dimensional, simple observation spaces. With the rise of deep reinforcement learning methods, this question can now be studied in complex multi-agent settings, which has led to flourishing activity in the area over the last two years. In these settings agents can learn to communicate in grounded multi-modal environments and rich communication protocols emerge.

Last year at NIPS 2017 we successfully organized the inaugural workshop on emergent communication (https://sites.google.com/site/emecom2017/). We had a number of interesting submissions looking into the question of how language can emerge using evolution (see this Nature paper that was also presented at the workshop last year, https://www.nature.com/articles/srep34615) and under what conditions emerged language exhibits compositional properties, while others explored specific applications of agents that can communicate (e.g., answering questions about textual inputs, a paper presented by Google that was subsequently accepted as an oral presentation at ICLR this year, etc.).

While last year’s workshop was a great success, there are a lot of open questions. In particular, the more challenging and realistic use cases come from situations where agents do not have fully aligned interests and goals, i.e., how can we have credible communication amongst self-interested agents where each agent maximizes its own individual rewards rather than a joint team reward? This is a new computational modeling challenge for the community and recent preliminary results (e.g. “Emergent Communication through Negotiation”, Cao et al., ICLR 2018.) reinforce the fact that it is no easy feat.

Since machine learning has exploded in popularity recently, there is a tendency for researchers to only engage with recent machine learning literature, therefore at best reinventing the wheel and at worst recycling the same ideas over and over, increasing the probability of being stuck in local optima. For these reasons, just like last year, we want to take an interdisciplinary approach on the topic of emergent communication, inviting researchers from different fields (machine learning, game theory, evolutionary biology, linguistics, cognitive science, and programming languages) interested in the question of communication and emergent language to exchange ideas.

This is particularly important for this year’s focus, since the question of communication in general-sum settings has been an active topic of research in game theory and evolutionary biology for a number of years, while it’s a nascent topic in the area of machine learning.

Sat 5:45 a.m. - 6:00 a.m. [iCal]
Opening Remarks (Talk)
Sat 6:00 a.m. - 6:30 a.m. [iCal]
Invited Talk 1: Luc Steels (Talk)
Luc L Steels
Sat 6:30 a.m. - 7:00 a.m. [iCal]
Contributed Talks I and II (Talk)
Sat 7:00 a.m. - 7:30 a.m. [iCal]
Invited Talk 2: Simon Huttegger (Talk)
Simon Huttegger
Sat 8:00 a.m. - 8:30 a.m. [iCal]
Invited Talk 3: He He (Talk)
He He
Sat 8:30 a.m. - 9:40 a.m. [iCal]
Spotlight Talks I (Spotlight)
Juan Leni, Michael Spranger, Ben Bogin, Shane Steinert-Threlkeld, Nicholas Tomlin, Fushan Li, Michael Noukhovitch, Tushar Jain, Jason Lee, Yen-Ling Kuo, Josefina Correa, Karol Hausman
Sat 9:40 a.m. - 11:45 a.m. [iCal]
Poster Session and Lunch (poster session)
Sat 11:45 a.m. - 12:00 p.m. [iCal]
Contributed Talk 3 (Contributed)
Sat 12:00 p.m. - 12:15 p.m. [iCal]
Contributed Talk 4 (talk)
Sat 12:15 p.m. - 12:45 p.m. [iCal]
Invited Talk 5: Nando de Freitas (Talk)
Nando de Freitas
Sat 12:45 p.m. - 1:15 p.m. [iCal]
Coffee Break (break)
Sat 1:15 p.m. - 1:45 p.m. [iCal]
Invited Talk 4: Jeff Clune (Talk)
Sat 1:45 p.m. - 2:50 p.m. [iCal]
Panel Discussion (Panel)
Sat 2:50 p.m. - 3:00 p.m. [iCal]
Closing Remarks (remarks)

Author Information

Jakob Foerster (University of Oxford)

Jakob Foerster is a PhD student in AI at the University of Oxford under the supervision of Shimon Whiteson and Nando de Freitas. Using deep reinforcement learning he studies the emergence of communication in multi-agent AI systems. Prior to his PhD Jakob spent four years working at Google and Goldman Sachs. Previously he has also worked on a number of research projects in systems neuroscience, including work at MIT and the Weizmann Institute.

Angeliki Lazaridou (DeepMind)
Ryan Lowe (McGill University)
Igor Mordatch (OpenAI)
Douwe Kiela (Facebook AI Research)
Kyunghyun Cho (NYU)

Kyunghyun Cho is an associate professor of computer science and data science at New York University and a research scientist at Facebook AI Research. He was a postdoctoral fellow at the Université de Montréal until summer 2015 under the supervision of Prof. Yoshua Bengio, and received PhD and MSc degrees from Aalto University early 2014 under the supervision of Prof. Juha Karhunen, Dr. Tapani Raiko and Dr. Alexander Ilin. He tries his best to find a balance among machine learning, natural language processing, and life, but almost always fails to do so.

More from the Same Authors