Workshop: Competition Track Saturday
Hugo Jair Escalante, Katja Hofmann
Sat, Dec 12th @ 16:00 GMT – Sun, Dec 13th @ 01:45 GMT
Abstract: Second session for the competition program at NeurIPS2020.
Machine learning competitions have grown in popularity and impact over the last decade, emerging as an effective means to advance the state of the art by posing well-structured, relevant, and challenging problems to the community at large. Motivated by a reward or merely the satisfaction of seeing their machine learning algorithm reach the top of a leaderboard, practitioners innovate, improve, and tune their approach before evaluating on a held-out dataset or environment. The competition track of NeurIPS has matured in 2020, its fourth year, with a considerable increase in both the number of challenges and the diversity of domains and topics. A total of 16 competitions are featured this year as part of the track, with 8 competitions associated to each of the two days. The list of competitions that ar part of the program are available here:
https://neurips.cc/Conferences/2020/CompetitionTrack
Machine learning competitions have grown in popularity and impact over the last decade, emerging as an effective means to advance the state of the art by posing well-structured, relevant, and challenging problems to the community at large. Motivated by a reward or merely the satisfaction of seeing their machine learning algorithm reach the top of a leaderboard, practitioners innovate, improve, and tune their approach before evaluating on a held-out dataset or environment. The competition track of NeurIPS has matured in 2020, its fourth year, with a considerable increase in both the number of challenges and the diversity of domains and topics. A total of 16 competitions are featured this year as part of the track, with 8 competitions associated to each of the two days. The list of competitions that ar part of the program are available here:
https://neurips.cc/Conferences/2020/CompetitionTrack
Video
Chat
Chat is not available.
Schedule
16:00 – 16:05 GMT
Introducing EfficientQA: Open domain question answering with memory constraints as a testbed for language understanding and knowledge representations
Tom Kwiatkowski
16:05 – 16:25 GMT
Track winner presentations:
Tom Kwiatkowski
- smallest question answering system with 25% accuracy - best performing system smaller than 500 Mb - best performing system smaller than 6Gb - best performing system overall
16:25 – 16:45 GMT
Showdown against trivia experts
Jordan Boyd-Graber
Five top human teams of trivia experts took on the competition’s baseline systems for the opportunity to take on the computer systems in each of the competition’s divisions. The team of humans will compete against the computer on thirty questions from the test set. We will present highlights from the preliminary competition as well as the final showdown between computer systems and the human teams.
17:00 – 17:06 GMT
Predicting Generalization in Deep Learning (PGDL): Opening remark
Yiding Jiang
17:06 – 17:16 GMT
Keynote speech: Sanjeev Arora (PGDL)
Sanjeev Arora, Yiding Jiang
17:16 – 17:17 GMT
Introduction to winning team (PGDL)
Yiding Jiang
17:17 – 17:27 GMT
Winning team presentation: On Representations and Generalization (PGDL)
Yiding Jiang, Parth Natekar, Manik Sharma
17:27 – 17:28 GMT
Introduction to Runner up 1 (PGDL)
Yiding Jiang
17:28 – 17:33 GMT
Runner up presentation: Robustness to Augmentations as a Generalization Metric (PGDL)
Sumukh Aithal K
17:33 – 17:34 GMT
Introduction to Runner up 2 (PGDL)
Yiding Jiang
17:34 – 17:39 GMT
Runner up presentation: Ranking generalization via smoothness of latent graphs (PGDL)
Carlos Lassance
17:39 – 17:44 GMT
Closing remark (PGDL)
Yiding Jiang
18:35 – 18:45 GMT
Analysis, research opportunities and closing of INTERPRET challenge
Liting Sun
19:00 – 19:05 GMT
NLC2CMD Competition Organizers: Introduction, Problem Description, CLAI
Mayank Agarwal
19:05 – 19:15 GMT
NLC2CMD Competition Keynote: Tellina
Victoria Lin, Mayank Agarwal, Tathagata Chakraborti
19:32 – 19:45 GMT
NLC2CMD Competition Organizers: Results (Live)
Kartik Talamadupula
22:00 – 22:03 GMT
Introduction to AIDO
Liam Paull
22:03 – 22:05 GMT
Short Scientific Talk (AIDO)
Luigi Di Lillo
22:05 – 22:13 GMT
Advanced Perception League
Liam Paull
22:13 – 22:19 GMT
Intro to Urban League (includes highlights from semifinals)
Liam Paull
22:19 – 22:34 GMT
Live robot competition (LF, LFP, lFVM)
Liam Paull
22:34 – 22:40 GMT
Interviews with winners
Liam Paull
22:40 – 22:43 GMT
Conclusions and Wrap up
Liam Paull
23:00 – 23:05 GMT
Introduction - Flatland
Sharada Mohanty
23:27 – 23:42 GMT
"Real world applications of Flatland" : Panel Discussion with SBB, DeutschBahn, SNCF
Sharada Mohanty
23:42 – 23:45 GMT
Concluding Remarks
Sharada Mohanty
00:00 – 00:03 GMT
Introduction - Procgen
Sharada Mohanty
00:25 – 00:44 GMT
Sample Efficiency & Generalization in RL : An assortment of tricks (talks by top participants)
Sharada Mohanty
00:44 – 00:45 GMT
Concluding Remarks
Sharada Mohanty
01:00 – 01:45 GMT
Introduction and results of the 2020 MineRL Competition
William Guss, Stephanie Milani, Nicholay Topin