Skip to yearly menu bar Skip to main content


Workshop

System-2 Reasoning at Scale

Shikhar Murty ⋅ Federico Bianchi ⋅ Róbert Csordás ⋅ Nouha Dziri ⋅ Alex Gu ⋅ Shunyu Yao ⋅ Christopher D Manning ⋅ Yejin Choi
[ OpenReview] 

Abstract

Video

Chat is not available.

Schedule

Timezone: America/Los_Angeles
9:00 AM
Poster setup
9:15 AM
Opening Remarks
Nouha Dziri ⋅ Alex Gu ⋅ Róbert Csordás
10:00 AM
Keynote: Josh Tenenbaum
Josh Tenenbaum
11:30 AM
Poster Session
1:00 PM
Lunch Break
2:35 PM
Invited Talk: Basis
Zenna Tavares ⋅ Kevin Ellis
3:35 PM
Panel DIscussion
Dzmitry Bahdanau ⋅ Jason Weston ⋅ Josh Tenenbaum ⋅ Francois Chollet ⋅ Melanie Mitchell
Compositional Generalization Across Distributional Shifts with Sparse Tree Operations
Paul Soulos ⋅ Henry Conklin ⋅ Mattia Opper ⋅ Paul Smolensky ⋅ Jianfeng Gao ⋅ Roland Fernandez
Interpretable Concept Bottlenecks to Align Reinforcement Learning Agents
Quentin Delfosse ⋅ Sebastian Sztwiertnia ⋅ Mark Rothermel ⋅ Wolfgang Stammer ⋅ Kristian Kersting
Enhancing Reasoning Capabilities of LLMs via Principled Synthetic Logic Corpus
Terufumi Morishita ⋅ Gaku Morio ⋅ Atsuki Yamaguchi ⋅ Yasuhiro Sogawa
Monte Carlo Tree Search Boosts Reasoning via Iterative Preference Learning
Yuxi Xie ⋅ Anirudh Goyal ⋅ Wenyue Zheng ⋅ Min-Yen Kan ⋅ Timothy Lillicrap ⋅ Kenji Kawaguchi ⋅ Michael Qizhe Shieh
ALTA: Compiler-Based Analysis of Transformers
Peter Shaw ⋅ James Cohan ⋅ Jacob Eisenstein ⋅ Kenton Lee ⋅ Jonathan Berant ⋅ Kristina N Toutanova
Improving LLM Generation with Inverse and Forward Alignment: Reward Modeling, Prompting, Fine-Tuning, and Inference-Time Optimization
Hao Sun ⋅ Thomas Pouplin ⋅ Nicolás Astorga ⋅ Tennison Liu ⋅ Mihaela van der Schaar
MovieCORE: COgnitive REasoning in Movies
Gueter Josmy Faure ⋅ Min-Hung Chen ⋅ Jia-Fong Yeh ⋅ Ying Cheng ⋅ Hung-Ting Su ⋅ Shang-Hong Lai ⋅ Winston Hsu
Thinking Fast and Laterally: Multi-Agentic Approach for Reasoning about Uncertain Emerging Events
Stefan Dernbach ⋅ Alejandro Michel ⋅ Khushbu Agarwal ⋅ Christopher Brissette ⋅ geetika gupta ⋅ Sutanay Choudhury
Equitable Access to Justice: Logical LLMs Show Promise
Manuj Kant ⋅ Marzieh Nabi ⋅ Manav Kant ⋅ Preston Carlson ⋅ Megan Ma
Consciousness-Inspired Spatio-Temporal Abstractions for Better Generalization in Reinforcement Learning
Mingde Zhao ⋅ Safa Alver ⋅ Harm Seijen ⋅ Romain Laroche ⋅ Doina Precup ⋅ Yoshua Bengio
Reasoning Abilities of Large Language Models through the Lens of Abstraction and Reasoning
Seungpil Lee ⋅ Woochang Sim ⋅ Donghyeon Shin ⋅ Sejin Kim ⋅ Sundong Kim
Proof Flow: Preliminary Study on Generative Flow Network Language Model Tuning for Formal Reasoning
Matthew Ho ⋅ Vincent Zhu ⋅ Xiaoyin Chen ⋅ Moksh Jain ⋅ Nikolay Malkin ⋅ Edwin Zhang
Can Language Models Perform Implicit Bayesian Inference Over User Preference States?
Linlu Qiu ⋅ Fei Sha ⋅ Kelsey Allen ⋅ Yoon Kim ⋅ Tal Linzen ⋅ Sjoerd van Steenkiste
Not All LLM Reasoners Are Created Equal
Arian Hosseini ⋅ Alessandro Sordoni ⋅ Daniel Toyama ⋅ Aaron Courville ⋅ Rishabh Agarwal
Generative Verifiers: Reward Modeling as Next-Token Prediction
Lunjun Zhang ⋅ Arian Hosseini ⋅ Hritik Bansal ⋅ Mehran Kazemi ⋅ Aviral Kumar ⋅ Rishabh Agarwal
The Turing Game
Michal Lewandowski ⋅ Simon Schmid ⋅ Patrick Mederitsch ⋅ Alexander Aufreiter ⋅ Gregor Aichinger ⋅ Felix Nessler ⋅ Severin Bergsmann ⋅ Viktor Szolga ⋅ Tobias Halmdienst ⋅ Bernhard Nessler
Distilling System 2 into System 1
Ping Yu ⋅ Jing Xu ⋅ Jason Weston ⋅ Ilia Kulikov
Algorithmic Language Models with Neurally Compiled Libraries
Lucas Saldyt ⋅ Subbarao Kambhampati
LLM Self-Correction with DeCRIM: Decompose, Critique, and Refine for Enhanced Following of Instructions with Multiple Constraints
Thomas Palmeira Ferraz ⋅ Kartik Mehta ⋅ Yu-Hsiang Lin ⋅ Haw-Shiuan Chang ⋅ Shereen Oraby ⋅ Sijia Liu ⋅ Vivek Subramanian ⋅ Tagyoung Chung ⋅ Mohit Bansal ⋅ Nanyun Peng
PROOF OF THOUGHT : Neurosymbolic Program Synthesis allows Robust and Interpretable Reasoning
Debargha Ganguly ⋅ Srinivasan Iyengar ⋅ Vipin Chaudhary ⋅ Shivkumar Kalyanaraman
Rational Metareasoning for Large Language Models
Camillo Nicolò De Sabbata ⋅ Ted Sumers ⋅ Tom Griffiths
Sampling Language from Latent System 2 Reasoning
Celine Lee ⋅ Md Arafat Sultan ⋅ Tahira Naseem ⋅ Alexander Rush ⋅ Ramón Astudillo
MemReasoner: A Memory-augmented LLM Architecture for Multi-hop Reasoning
Ching-Yun Ko ⋅ Sihui Dai ⋅ Payel Das ⋅ Georgios Kollias ⋅ Subhajit Chaudhury ⋅ Aurelie Lozano
World Models for Web Agents
Hyungjoo Chae ⋅ Namyoung Kim ⋅ Minju Gwak ⋅ Gwanwoo Song ⋅ Jihoon Kim ⋅ Kai Ong ⋅ Seonghwan Kim ⋅ Dongha Lee ⋅ Jinyoung Yeo
Recursive Decomposition with Dependencies for Generic Divide-and-Conquer Reasoning
Sergio Hernández-Gutiérrez ⋅ Minttu Alakuijala ⋅ Alexander Nikitin ⋅ Pekka Marttinen
Horizon-Length Prediction: Advancing Fill-in-the-Middle Capabilities for Code Generation with Lookahead Planning
Yifeng Ding ⋅ Hantian Ding ⋅ Shiqi Wang ⋅ Qing Sun ⋅ Varun Kumar ⋅ Zijian Wang
Automated Design of Agentic Systems
Shengran Hu ⋅ Cong Lu ⋅ Jeff Clune
Logically Consistent Language Models via Neuro-Symbolic Integration
Diego Calanzone ⋅ Stefano Teso ⋅ Antonio Vergari
LLMs on interactive feature collections with implicit look-ahead strategies
Juyeon Heo ⋅ Vihari Piratla ⋅ Kyunghyun Lee ⋅ Hyonkeun Joh ⋅ Adrian Weller
softmax is not enough (for sharp out-of-distribution)
Petar Veličković ⋅ Christos Perivolaropoulos ⋅ Federico Barbero ⋅ Razvan Pascanu
Can Stories Help LLMs Reason? Curating Information Space Through Narrative
Vahid Sadiri Javadi ⋅ Johanne Trippas ⋅ Lucie Flek
Your Context Is Not an Array: Unveiling Random Access Limitations in Transformers
Reza Ebrahimi ⋅ Sunny Panchal ⋅ Roland Memisevic
A Llama Sunk My Battleship! Asking Rational Questions with LLMs via Bayesian Inference
Gabriel Grand ⋅ Valerio Pepe ⋅ Jacob Andreas ⋅ Josh Tenenbaum
Implicit Reasoning in Deep Time Series Forecasting
Willa Potosnak ⋅ Cristian Challu ⋅ Mononito Goswami ⋅ Michal Wilinski ⋅ Nina Żukowska ⋅ Artur Dubrawski
Thought of Search: Planning with Language Models Through The Lens of Efficiency
Michael Katz ⋅ Harsha Kokel ⋅ Kavitha Srinivas ⋅ Shirin Sohrabi Araghi
Planning in Natural Language Improves LLM Search for Code Generation
Evan Wang ⋅ Federico Cassano ⋅ Catherine Wu ⋅ Yunfeng Bai ⋅ William Song ⋅ Vaskar Nath ⋅ Ziwen Han ⋅ Sean Hendryx ⋅ Summer Yue ⋅ Hugh Zhang
Doing Experiments and Revising Rules with Natural Language and Probabilistic Reasoning
Top Piriyakulkij ⋅ Cassidy Langenfeld ⋅ Tuan Anh Le ⋅ Kevin Ellis
Recurrent Transformers Trade-off Parallelism for Length Generalization on Regular Languages
Paul Soulos ⋅ Aleksandar Terzic ⋅ Michael Hersche ⋅ Abbas Rahimi
VCR: Visual Caption Restoration
Tianyu Zhang ⋅ Suyuchen Wang ⋅ Lu Li ⋅ Ge Zhang ⋅ Perouz Taslakian ⋅ Sai Rajeswar Mudumba ⋅ Jie Fu ⋅ Bang Liu ⋅ Yoshua Bengio
Can LLMs Reason with Rules? Logic Scaffolding for Stress-Testing and Improving LLMs
Siyuan Wang ⋅ zhongyu wei ⋅ Yejin Choi ⋅ Xiang Ren
Bongard in Wonderland: Visual Puzzles that Still Make AI Go Mad?
Antonia Wüst ⋅ Tim Nelson Tobiasch ⋅ Lukas Helff ⋅ Devendra S Dhami ⋅ Constantin Rothkopf ⋅ Kristian Kersting
Diffusion On Syntax Trees For Program Synthesis
Shreyas Kapur ⋅ Erik Jenner ⋅ Stuart J Russell