Skip to yearly menu bar Skip to main content


Competition

HAC: The Hacker-Cup AI Competition

Weiwei Yang · Mark Saroufim · Joseph Isaacson · Luca Antiga · Greg Bowyer · Christian Puhrsch · Driss Guessous · Supriya Rao · Geeta Chauhan · Margaret Li · David Harmeyer · Wesley May

[ ]
Sun 15 Dec 8:15 a.m. PST — 5:30 p.m. PST

Abstract:

We are launching the first AI track for the popular Meta Hacker Cup programmingcompetition, designed to assess the capabilities of Generative AI in performingautonomous code generation tasks. We aim to test the limits of AI in complexcoding challenges and measure the performance gap between AI systems andhuman programmers. We will provide access to all Hacker Cup problems since 2011alongside their respective solutions in a multimodal (image and text) format, andutilize the existing Hacker Cup infrastructure for competitor evaluation. Featuringboth "open evaluation, open model" and "open evaluation, closed model" tracks,this competition invites diverse participation from research institutions of variedinterests and resource constraints, including academic labs, AI startups, largetechnology companies, and AI enthusiasts. Our goal is to develop and democratizemeaningful advancements in code automation with the very first open evaluationprocess for competitive AI programmers.

Live content is unavailable. Log in and register to view live content