Timezone: »
This workshop focuses on “machine teaching”, the inverse problem of machine learning, in which the goal is to find an optimal training set given a machine learning algorithm and a target model. The study of machine teaching began in the early 1990s, primarily coming out of computational learning theory. Recently, there has been a surge of interest in machine teaching as several different communities within machine learning have found connections to this problem; these connections have included the following:
* machine teaching has close connections to newly introduced models of interaction in machine learning community, such as curriculum learning, self-paced learning, and knowledge distillation. [Hinton et al. 2015; Bengio et al. 2009]
* there are strong theoretical connections between the Teaching-dimension (the sample complexity of teaching) and the VC-dimension (the sample complexity of learning from randomly chosen examples). [Doliwa et al. 2014]
* machine teaching problem formulation has been recently studied in the context of diverse applications including personalized educational systems, cyber-security problems, robotics, program synthesis, human-in-the-loop systems, and crowdsourcing. [Jha et al. 2016; Zhu 2015; Mei & Zhu 2015; Ba & Caruana 2014; Patil et al. 2014; Singla et al. 2014; Cakmak & Thomaz 2014]
In this workshop, we draw attention to machine teaching by emphasizing how the area of machine teaching interacts with emerging research trends and application domains relevant to the NIPS community. The goal of this workshop is to foster these ideas by bringing together researchers with expertise/interest in the inter-related areas of machine teaching, interactive machine learning, robotics, cyber-security problems, generative adversarial networks, educational technologies, and cognitive science.
Topics of interests in the workshop include (but are not limited to):
* Theoretical foundations of machine teaching:
* using tools from information theory to develop better mathematical models of teaching;
* characterizing the complexity of teaching when a teacher has limited power, or incomplete knowledge of student’s model, or a mismatch in feature representations;
* algorithms for adaptive teaching by interactively inferring the learner’s state;
* new notions of Teaching-dimension for generic teaching settings.
* Connections to machine learning models:
* the information complexity of teaching and query complexity;
* machine teaching vs. curriculum learning and other models of interactive machine learning;
* teaching reinforcement learning agents.
Applications of machine teaching to adversarial attacks, including cyber-security problems, generative adversarial networks, attacks on machine learning algorithms, etc.
* Applications of machine teaching to educational technologies:
* using the machine teaching formulation to enable more rigorous and generalizable approaches for developing intelligent tutoring systems;
* behavioral experiments to identify good cognitive models of human learning processes.
* Novel applications for machine teaching such as program synthesis, human-robot interactions, social robotics, etc.
Sat 9:00 a.m. - 10:00 a.m.
|
Overview of Machine Teaching
(
Tutorial
)
|
🔗 |
Sat 10:00 a.m. - 10:30 a.m.
|
"Reinforcement Learning with People" - Emma Brunskill (Stanford)
(
Talk
)
|
🔗 |
Sat 11:00 a.m. - 11:30 a.m.
|
"Active Classification with Comparison Queries" - Shay Moran (Technion)
(
Talk
)
|
🔗 |
Sat 11:30 a.m. - 12:00 p.m.
|
Discussion session (Topic: Open questions and new research directions)
(
Discussion
)
|
🔗 |
Sat 2:00 p.m. - 2:30 p.m.
|
"Iterative Machine Teaching" - Le Song (Georgia Tech)
(
Talk
)
|
🔗 |
Sat 2:30 p.m. - 3:00 p.m.
|
Spotlight presentations for posters (14 papers)
(
Spotlights
)
|
🔗 |
Sat 3:30 p.m. - 4:30 p.m.
|
Poster presentations (14 papers)
(
Poster session
)
|
🔗 |
Sat 4:30 p.m. - 5:00 p.m.
|
"Machine Teaching: A New Paradigm for Building Machine Learning Systems" - Patrice Simard (Microsoft Research)
(
Talk
)
|
🔗 |
Sat 5:00 p.m. - 5:30 p.m.
|
"Improving Language Learning and Assessment with Data" - Burr Settles (Duolingo)
(
Talk
)
|
🔗 |
Sat 5:30 p.m. - 6:00 p.m.
|
Discussion session (Topic: Novel applications and industry insights)
(
Discussion
)
|
🔗 |
Author Information
Maya Cakmak (University of Washington)
Anna Rafferty (Carleton College)
Adish Singla (MPI-SWS)
Jerry Zhu (University of Wisconsin-Madison)
Sandra Zilles (zilles@cs.uregina.ca)
More from the Same Authors
-
2021 : Assistive Tele-op: Leveraging Transformers to Collect Robotic Task Demonstrations »
Henry Clever · Ankur Handa · Hammad Mazhar · Qian Wan · Yashraj Narang · Maya Cakmak · Dieter Fox -
2021 : Algorithms for Adaptive Experiments that Trade-off Statistical Analysis with Reward: Combining Uniform Random Assignment and Reward Maximization »
Jacob Nogas · Arghavan Modiri · · Sofia Villar · Audrey Durand · Anna Rafferty · Joseph Williams -
2021 : Game Redesign in No-regret Game Playing »
Yuzhe Ma · Young Wu · Jerry Zhu -
2021 : Reward Poisoning in Reinforcement Learning: Attacks Against Unknown Learners in Unknown Environments »
Amin Rakhsha · Xuezhou Zhang · Jerry Zhu · Adish Singla -
2021 : Game Redesign in No-regret Game Playing »
Yuzhe Ma · Young Wu · Jerry Zhu -
2021 : Reward Poisoning in Reinforcement Learning: Attacks Against Unknown Learners in Unknown Environments »
Amin Rakhsha · Xuezhou Zhang · Jerry Zhu · Adish Singla -
2022 Poster: On Batch Teaching with Sample Complexity Bounded by VCD »
Farnam Mansouri · Hans Simon · Adish Singla · Sandra Zilles -
2023 Workshop: Generative AI for Education (GAIED): Advances, Opportunities, and Challenges »
Paul Denny · Sumit Gulwani · Neil Heffernan · Tanja Käser · Steven Moore · Anna Rafferty · Adish Singla -
2022 Spotlight: On Batch Teaching with Sample Complexity Bounded by VCD »
Farnam Mansouri · Hans Simon · Adish Singla · Sandra Zilles -
2022 Poster: Provable Defense against Backdoor Policies in Reinforcement Learning »
Shubham Bharti · Xuezhou Zhang · Adish Singla · Jerry Zhu -
2019 Poster: Policy Poisoning in Batch Reinforcement Learning and Control »
Yuzhe Ma · Xuezhou Zhang · Wen Sun · Jerry Zhu -
2019 Poster: Preference-Based Batch and Sequential Teaching: Towards a Unified View of Models »
Farnam Mansouri · Yuxin Chen · Ara Vartanian · Jerry Zhu · Adish Singla -
2019 Poster: A Unified Framework for Data Poisoning Attack to Graph-based Semi-supervised Learning »
Xuanqing Liu · Si Si · Jerry Zhu · Yang Li · Cho-Jui Hsieh -
2018 Poster: Adversarial Attacks on Stochastic Bandits »
Kwang-Sung Jun · Lihong Li · Yuzhe Ma · Jerry Zhu -
2016 : Optimal Teaching for Online Perceptrons »
Xuezhou Zhang · Jerry Zhu -
2016 Workshop: Crowdsourcing and Machine Learning »
Adish Singla · Rafael Frongillo · Matteo Venanzi -
2016 Workshop: The Future of Interactive Machine Learning »
Kory Mathewson @korymath · Kaushik Subramanian · Mark Ho · Robert Loftin · Joseph L Austerweil · Anna Harutyunyan · Doina Precup · Layla El Asri · Matthew Gombolay · Jerry Zhu · Sonia Chernova · Charles Isbell · Patrick M Pilarski · Weng-Keen Wong · Manuela Veloso · Julie A Shah · Matthew Taylor · Brenna Argall · Michael Littman -
2016 Poster: Active Learning with Oracle Epiphany »
Tzu-Kuo Huang · Lihong Li · Ara Vartanian · Saleema Amershi · Jerry Zhu -
2015 Poster: Human Memory Search as Initial-Visit Emitting Random Walk »
Kwang-Sung Jun · Jerry Zhu · Timothy T Rogers · Zhuoran Yang · Ming Yuan -
2014 Workshop: NIPS’14 Workshop on Crowdsourcing and Machine Learning »
David Parkes · Denny Zhou · Chien-Ju Ho · Nihar Bhadresh Shah · Adish Singla · Jared Heyman · Edwin Simpson · Andreas Krause · Rafael Frongillo · Jennifer Wortman Vaughan · Panagiotis Papadimitriou · Damien Peters -
2014 Poster: Optimal Teaching for Limited-Capacity Human Learners »
Kaustubh R Patil · Jerry Zhu · Łukasz Kopeć · Bradley C Love -
2014 Spotlight: Optimal Teaching for Limited-Capacity Human Learners »
Kaustubh R Patil · Jerry Zhu · Łukasz Kopeć · Bradley C Love -
2013 Workshop: Crowdsourcing: Theory, Algorithms and Applications »
Jennifer Wortman Vaughan · Greg Stoddard · Chien-Ju Ho · Adish Singla · Michael Bernstein · Devavrat Shah · Arpita Ghosh · Evgeniy Gabrilovich · Denny Zhou · Nikhil Devanur · Xi Chen · Alexander Ihler · Qiang Liu · Genevieve Patterson · Ashwinkumar Badanidiyuru Varadaraja · Hossein Azari Soufiani · Jacob Whitehill -
2013 Poster: Machine Teaching for Bayesian Learners in the Exponential Family »
Jerry Zhu -
2011 Poster: How Do Humans Teach: On Curriculum Learning and Teaching Dimension »
Faisal Khan · Jerry Zhu · Bilge Mutlu -
2011 Poster: Learning Higher-Order Graph Structure with Features by Structure Penalty »
Shilin Ding · Grace Wahba · Jerry Zhu -
2010 Oral: Humans Learn Using Manifolds, Reluctantly »
Bryan R Gibson · Jerry Zhu · Timothy T Rogers · Chuck Kalish · Joseph Harrison -
2010 Poster: Humans Learn Using Manifolds, Reluctantly »
Bryan R Gibson · Jerry Zhu · Timothy T Rogers · Chuck Kalish · Joseph Harrison -
2010 Poster: Transduction with Matrix Completion: Three Birds with One Stone »
Andrew B Goldberg · Jerry Zhu · Benjamin Recht · Junming Sui · Rob Nowak -
2010 Session: Spotlights Session 1 »
Jerry Zhu -
2009 Poster: Human Rademacher Complexity »
Jerry Zhu · Timothy T Rogers · Bryan R Gibson -
2008 Workshop: Machine learning meets human learning »
Nathaniel D Daw · Tom Griffiths · Josh Tenenbaum · Jerry Zhu -
2008 Poster: Human Active Learning »
Jerry Zhu · Rui M Castro · Timothy T Rogers · Rob Nowak · Ruichen Qian · Chuck Kalish -
2008 Poster: Unlabeled data: Now it helps, now it doesn't »
Aarti Singh · Rob Nowak · Jerry Zhu -
2008 Oral: Unlabeled data: Now it helps, now it doesn't »
Aarti Singh · Rob Nowak · Jerry Zhu