Workshop
Learning by Instruction
Shashank Srivastava 路 Igor Labutov 路 Bishan Yang 路 Amos Azaria 路 Tom Mitchell
Sat 8 Dec, 5 a.m. PST
Today machine learning is largely about pattern discovery and function approximation. But as computing devices that interact with us in natural language become ubiquitous (e.g., Siri, Alexa, Google Now), and as computer perceptual abilities become more accurate, they open an exciting possibility of enabling end-users to teach machines similar to the way in which humans teach one another. Natural language conversation, gesturing, demonstrating, teleoperating and other modes of communication offer a new paradigm for machine learning through instruction from humans. This builds on several existing machine learning paradigms (e.g., active learning, supervised learning, reinforcement learning), but also brings a new set of advantages and research challenges that lie at the intersection of several fields including machine learning, natural language understanding, computer perception, and HCI.
The aim of this workshop is to engage researchers from these diverse fields to explore fundamental research questions in this new area, such as:
How do people interact with machines when teaching them new learning tasks and knowledge?
What novel machine learning models and algorithms are needed to learn from human instruction?
What are the practical considerations towards building practical systems that can learn from instruction?
Schedule
Sat 5:30 a.m. - 5:35 a.m.
|
Introduction
(
Welcome
)
>
|
馃敆 |
Sat 5:35 a.m. - 6:00 a.m.
|
Teaching Machines like we Teach People
(
Talk from Organizers
)
>
|
馃敆 |
Sat 6:00 a.m. - 6:30 a.m.
|
Mapping Navigation Instructions to Continuous Control
(
Invited Talk
)
>
|
Yoav Artzi 馃敆 |
Sat 6:30 a.m. - 7:00 a.m.
|
An Cognitive Architecture Approach to Interactive Task Learning
(
Invited Talk
)
>
|
John Laird 馃敆 |
Sat 7:00 a.m. - 7:15 a.m.
|
Compositional Imitation Learning: Explaining and executing one task at a time
(
Contributed Talk
)
>
|
Thomas Kipf 馃敆 |
Sat 7:15 a.m. - 7:30 a.m.
|
Learning to Learn from Imperfect Demonstrations
(
Contributed Talk
)
>
|
Ge Yang 路 Chelsea Finn 馃敆 |
Sat 8:00 a.m. - 8:30 a.m.
|
Natural Language Supervision
(
Invited Talk
)
>
|
Percy Liang 馃敆 |
Sat 8:30 a.m. - 9:00 a.m.
|
Control Algorithms for Imitation Learning from Observation
(
Invited Talk
)
>
|
Peter Stone 馃敆 |
Sat 9:00 a.m. - 9:15 a.m.
|
From Language to Goals: Inverse Reinforcement Learning for Vision-Based Instruction Following
(
Contributed talk
)
>
|
Justin Fu 馃敆 |
Sat 9:15 a.m. - 9:30 a.m.
|
Teaching Multiple Tasks to an RL Agent using LTL
(
Contributed Talk
)
>
|
Rodrigo Toro Icarte 路 Sheila McIlraith 馃敆 |
Sat 10:30 a.m. - 11:00 a.m.
|
Meta-Learning to Follow Instructions, Examples, and Demonstrations
(
Invited Talk
)
>
|
Sergey Levine 馃敆 |
Sat 11:00 a.m. - 11:30 a.m.
|
Learning to Understand Natural Language Instructions through Human-Robot Dialog
(
Invited Talk
)
>
|
Raymond Mooney 馃敆 |
Sat 11:30 a.m. - 11:45 a.m.
|
The Implicit Preference Information in an Initial State
(
Contributed Talk
)
>
|
Rohin Shah 馃敆 |
Sat 11:45 a.m. - 12:00 p.m.
|
Modelling User's Theory of AI's Mind in Interactive Intelligent Systems
(
Contributed Talk
)
>
|
Tomi Peltola 馃敆 |
Sat 12:30 p.m. - 1:15 p.m.
|
Poster Session
(
Poster Session
)
>
|
12 presentersCarl Trimbach 路 Mennatullah Siam 路 Rodrigo Toro Icarte 路 Zhongtian Dai 路 Sheila McIlraith 路 Matthew Rahtz 路 Robert Sheline 路 Christopher MacLellan 路 Carolin Lawrence 路 Stefan Riezler 路 Dylan Hadfield-Menell 路 Fang-I Hsiao |
Sat 1:15 p.m. - 1:30 p.m.
|
Assisted Inverse Reinforcement Learning
(
Contributed Talk
)
>
|
Adish Singla 路 Rati Devidze 馃敆 |
Sat 1:30 p.m. - 2:00 p.m.
|
Teaching through Dialogue and Games
(
Invited Talk
)
>
|
Jason E Weston 馃敆 |
Sat 2:00 p.m. - 2:45 p.m.
|
Panel Discussion
(
Discussion Panel
)
>
|
馃敆 |