NeurIPS 2020 Call for Competitions

We invite proposals for the Neural Information Processing Systems 2020 (NeurIPS 2020) competition track to be held in Vancouver, Canada. After the success of the past three years, a fourth edition of the competition track will be held at NeurIPS 2020. We solicit competition proposals on any topic of interest to the NeurIPS community. We especially encourage competition proposals from emerging new fields or new application domains related to NeurIPS. Interdisciplinary topics that will attract a significant cross-section of the community are especially highly encouraged.

As in previous years, there will be two types of competitions:

  1. Standard data science competitions, where participants will compete to obtain the best score on a machine learning task of interest to the NeurIPS community based on a problem and data defined and released by the organizers of the competition.

  2. Live competitions, which will be held in a “science-fair” manner at NeurIPS 2020. Participants will present live demos at NeurIPS 2020 which apply methodology to an application domain defined by the organizers of the live competition.

There will be a competition track at NeurIPS 2020, co-located with the conference workshops, where competition results will be presented and discussed. Competition organizers will be asked to propose a tentative schedule for presentation of the competition and its results during an assigned time slot; NeurIPS will provide coffee breaks. A new addition to the NeurIPS 2020 Competition track will be a joint poster session where participants of all competitions can share and discuss their results. Publication opportunities are being explored for organizers and participants of competitions and will be announced after acceptance of competition. 

 

PROPOSAL SUBMISSION

Standard data science and live competition proposals must both be submitted via CMT at: 

https://cmt3.research.microsoft.com/COMPNeurIPS2020/

Please carefully follow the provided Latex template (https://tinyurl.com/NeurIPS2020) when preparing proposals.

 

REVIEWING AND SELECTION PROCESS

A competition program committee will be formed, consisting of experts on both machine learning and challenge organization. Each proposal will be reviewed by at least three members of the committee. The factors that will be considered when evaluating proposals include:

  • Task chosen: Impact, originality, relevance to the NeurIPS community will all be considered. Tasks that include humanitarian and/or positive societal impact are especially highly encouraged this year, although other topics relevant to the NeurIPS community will also be considered. If humanitarian projects are submitted, the involvement of the community in question is strongly desired, and “parachute science” is strongly discouraged.

  • Protocol of competition: Feasibility of the task chosen, soundness of the evaluation criteria, and clarity and fairness of the competition rules will all be considered.

  • Logistics: Schedule, plan for attracting competition participants, and experience and diversity of the organizers will all be considered. The specific plan for attracting participants of groups under-represented at NeurIPS will be considered.

IMPORTANT DATES (anywhere on earth)

  • Competition proposal submission deadline: March 13, 2020

  • Acceptance notification: April 13, 2020

  • Competition track: December, 2020

ADDITIONAL COMMENTS

  • Competition organizers should propose a timeline for running the competition to ensure that participants have enough time to contribute high-quality entries. It is recommended that competitions be completed by the end of October 2020 at the absolute latest.

  • Competition organizers that require help or suggestions regarding competition platforms for running the competition can contact the competition chairs for advice.

2019 accepted competitions

2018 accepted competitions

2017 accepted competitions

 

DEMONSTRATION  AND COMPETITION CHAIRS

Katja Hofmann, Microsoft Research, UK.

Hugo Jair Escalante, INAOE-CINVESTAV, ChaLearn.

Contact: neurips-2020-demonstrations-demos@googlegroups.com