Skip to yearly menu bar Skip to main content


Call for Reproducibility Papers

NeurIPS is committed to promoting reproducibility, replicability, and generalizability of published claims in its conference and machine learning (ML) conferences/journals. In order to formalize the process further, we are delighted to officially partner with the Machine Learning Reproducibility Challenge (MLRC). In particular, we will experiment with integrating MLRC 2026 as an official track of NeurIPS 2026. MLRC has been the primary venue for publishing reproducibility studies and research over many years, and we are happy to add MLRC as an official track at NeurIPS 2026.

Accepted reproducibility papers will be presented at NeurIPS 2026 (Sydney only) alongside papers from the other tracks. As a track within NeurIPS, MLRC is complementary to the Main Track and the Evaluations & Datasets Track. Work that strengthens the field's commitment to reproducible, open science is welcome for submission.

Submissions must be first accepted to TMLR to be considered in the NeurIPS 2026 presentation and MLRC 2026 proceedings. Please read the author guidelines and submission guidelines from TMLR to get the submission format and to understand more about the reviewing process. Existing papers related to the scope (with reproducibility certification) already published at TMLR are also welcome for consideration by the committee. Note that papers in this track will still be TMLR proceedings, similar to Journal to Conference. Please read our announcement blog post for more information.

Scope

We invite submissions centered on the reproducibility, replicability, and generalizability of published claims in ML. MLRC welcomes rigorous work across the full spectrum of outcomes, including positive confirmations of prior results, partial replications, and failures to reproduce, as long as reproducibility is the central focus. Submissions may concern any paper or set of papers published in top ML conferences and journals from 2025 to present.

Topics include, but are not limited to:

  • Reproduction and replication of published claims, including rigorous confirmation of prior results
  • Generalizability of published claims: novel insights and extensions beyond the original paper
  • Meta-reproducibility studies examining a set of related papers
  • Meta-analyses of the state of reproducibility across subfields of machine learning
  • Methods, tools, and infrastructure to support reproducibility research in machine learning
  • Open replications, artifacts, and resources that advance open science in reproducible ML
  • AI tools and automated methods for replicating research papers, including studies that use or evaluate such tools
  • Reproducibility of AI agents and AI systems
 

Note: While the scope does not exclude reproducibility of evaluation systems, the Evaluations and Datasets NeurIPS 2026 track is also a good venue for submitting papers focusing on evaluation as a broader scientific object. For generalizable insights on evaluations, consider submitting to that track, while this track can be utilized for replicability and stress-testing of evaluation benchmarks.

Submission Details

 

Who can submit?

To be eligible for MLRC, the reproducibility paper / study must be accepted as is / with minor revisions to TMLR between the eligibility window of June 20, 2025 23:59 AOE and September 30, 2026, 23:59 AOE. Reproducibility studies accepted to TMLR outside this window are not eligible.

 

How to submit?

MLRC accepts submissions through three paths:

Path 1: Expression of interest (EOI) before acceptance. If your reproducibility paper is currently under review at TMLR and was submitted within the eligibility window, you may submit this EOI form to express your intent to be considered for MLRC. The “intent to submit” deadline is June 4, 2026, AOE - this is primarily a soft deadline to allow you to submit your paper to TMLR well in advance, so that you get your decisions in time. If your reproducibility paper is subsequently accepted to TMLR, you will be asked to update the form with your acceptance details and camera-ready materials. The hard deadline by which we need your TMLR paper’s acceptance decision is September 30, 2026, AOE - we cannot accommodate your paper into MLRC any later than this date, even if you are still waiting for your TMLR decisions.

Path 2: Self-nomination after acceptance. If your reproducibility paper has already been accepted to TMLR and was submitted within the eligibility window (start date June 20, 2025 23:59 AOE), you may submit this form to be considered for MLRC. Once accepted to MLRC, you will be asked to update the form with your camera-ready details. Similar to Path 1, the hard deadline to submit this form is September 30, 2026, AOE. Ensure you have not submitted your accepted paper to the NeurIPS 2026 Journal to Conference track, as our dual submission policy restricts dual presentation.

Path 3: Area Chair nomination. TMLR Area Chairs may nominate accepted reproducibility papers within the submission window for consideration at MLRC. No action is required from authors unless they are contacted. Area Chairs can use the same form to submit their nomination. The deadline for TMLR Area Chairs to nominate reproducibility papers is also September 30, 2026, AOE.

For all paths, please read the TMLR author guidelines and submission guidelines for formatting and review process details.

 

Dual Submission Policy

Accepted TMLR papers chosen to be presented at the MLRC track cannot be presented at any other NeurIPS 2026 track, including the Journal-to-Conference Track. Authors should ensure their paper is not under consideration for presentation at another track at the time of submission to MLRC.

Code & Artifacts

Sharing the code used to produce your results is strongly recommended. Authors should archive their implementation using the Software Heritage Archive, which provides a permanent, citable identifier for source code. A link to the archived code should be included in the paper. Making your implementation publicly available helps the community verify and build on your findings, and is in the spirit of the reproducibility mission of MLRC.

Review Process

MLRC 2026 papers are reviewed through TMLR. Once a paper is accepted at TMLR with a reproducibility certification, it undergoes a light compatibility review by the MLRC committee to verify suitability for the track and to determine eligibility for oral and poster presentation at NeurIPS 2026. This review is primarily to check the alignment of the paper with the scope of the program, and the MLRC organizers will take a final decision on the inclusion of this paper to the track.

Important Dates

  • Earliest date of the acceptance of your TMLR reproducibility paper for consideration to this year’s MLRC: June 20, 2025 23:59 AOE
  • Soft deadline to share your intent to submit a TMLR paper to MLRC: June 4, 2026 23:59 AOE
  • Deadline to have your TMLR decisions in our system: September 30, 2026, AOE
  • Announcement of accepted papers/author notifications: October 7, 2026
  • NeurIPS 2026 Dates: December 6-13, 2026, Sydney, Australia

Further Information

Please see the MLRC 2026 website for more details about the track, including FAQ, and past iteration proceedings.

Contact

For questions and additional information, contact the Reproducibility Chairs and MLRC 2026 Organizers at reproducibility-chairs@neurips.cc.