Skip to yearly menu bar Skip to main content


Workshop

Adaptive Foundation Models: Evolving AI for Personalized and Efficient Learning

Mengye Ren ⋅ Paul Vicol ⋅ Naila Murray ⋅ Renjie Liao ⋅ Beidi Chen ⋅ Wei-Chiu Ma
Project Page [ OpenReview] 

Abstract

Video

Chat is not available.

Schedule

Timezone: America/Los_Angeles
8:30 AM
Keynote: Tree Search for Language Model Agents
Ruslan Salakhutdinov
9:00 AM
Multimodal Iterative Refinement
Sander Dieleman
9:30 AM
Coffee Break
10:15 AM
One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
Fabian Paischer ⋅ Lukas Hauzenberger ⋅ Thomas Schmied ⋅ Benedikt Alkin ⋅ Marc Deisenroth ⋅ Sepp Hochreiter
10:25 AM
Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Merging
Joel Jang ⋅ Seungone Kim ⋅ Bill Yuchen Lin ⋅ Yizhong Wang ⋅ Jack Hessel ⋅ Luke Zettlemoyer ⋅ Hannaneh Hajishirzi ⋅ Yejin Choi ⋅ Prithviraj Ammanabrolu
10:35 AM
RAGGED: Towards Informed Design of Retrieval Augmented Generation Systems
Jennifer Hsia ⋅ Afreen Shaikh ⋅ Zhiruo Wang ⋅ Graham Neubig
11:45 AM
Lunch Break
1:00 PM
Continual Foundation Model Learning
Matthias Bethge ⋅ Matthias Bethge ⋅ Vishaal Udandarao
2:00 PM
Self-Play Preference Optimization for Language Model Alignment
Yue Wu ⋅ Zhiqing Sun ⋅ Huizhuo Yuan ⋅ Kaixuan Ji ⋅ Yiming Yang ⋅ Quanquan Gu
2:10 PM
Fast and Accurate Language Model Decoding via Parallel Token Processing
Zhepei Wei ⋅ Wei-Lin Chen ⋅ Xinyu Zhu ⋅ Yu Meng
2:20 PM
Fine-tuning LLM Agents with Retrospective In-Context Online Learning
Wen-Tse Chen ⋅ Jiayu Chen ⋅ Fahim Tajwar ⋅ Hao Zhu ⋅ Xintong Duan ⋅ Ruslan Salakhutdinov ⋅ Jeff Schneider
2:30 PM
Are LLMs Prescient? A Continuous Evaluation using Daily News as the Oracle
Amelia Hui Dai ⋅ Ryan Teehan ⋅ Mengye Ren
2:40 PM
Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass
Tong Chen ⋅ Hao Fang ⋅ Patrick Xia ⋅ Xiaodong Liu ⋅ Ben Van Durme ⋅ Luke Zettlemoyer ⋅ Jianfeng Gao ⋅ Hao Cheng
2:50 PM
Coffee Break
4:00 PM
Panel Discussion
Ruslan Salakhutdinov ⋅ Sander Dieleman ⋅ Kate Saenko ⋅ Matthias Bethge ⋅ Minjoon Seo ⋅ Bing Liu
Towards Personalized Language Models via Inference-time Human Preference Optimization
Nikki Lijing Kuang ⋅ Wei Sun ⋅ Scott McFaddin ⋅ Yian Ma ⋅ Markus Ettl
XLand-100B: A Large-Scale Multi-Task Dataset for In-Context Reinforcement Learning
Alexander Nikulin ⋅ Ilya Zisman ⋅ Alexey Zemtsov ⋅ Vladislav Kurenkov
SeCom: On Memory Construction and Retrieval for Personalized Conversational Agents
Zhuoshi Pan ⋅ Qianhui Wu ⋅ Huiqiang Jiang ⋅ Xufang Luo ⋅ Hao Cheng ⋅ Dongsheng Li ⋅ Yuqing Yang ⋅ Chin-Yew Lin ⋅ H. Vicky Zhao ⋅ Lili Qiu ⋅ Jianfeng Gao
metaTextGrad: Learning to learn with language models as optimizers
Guowei Xu ⋅ Mert Yuksekgonul ⋅ Carlos Guestrin ⋅ James Zou
Adapting Foundation Models via Training-free Dynamic Weight Interpolation
Changdae Oh ⋅ Sharon Li ⋅ Kyungwoo Song ⋅ Sangdoo Yun ⋅ Dongyoon Han
Personalized Language Modeling from Personalized Human Feedback
Xinyu Li ⋅ Ruiyang Zhou ⋅ Zachary Lipton ⋅ Liu Leqi
AdaptAgent: Adapting Multimodal Web Agents with Few-Shot Learning from Human Demonstrations
Gaurav Verma ⋅ Rachneet Kaur ⋅ Nishan Srishankar ⋅ Zhen Zeng ⋅ Tucker Balch ⋅ Manuela Veloso
ZO-Offloading: Fine-Tuning LLMs with 100 Billion Parameters on a Single GPU
Liangyu Wang ⋅ Jie Ren ⋅ Hang Xu ⋅ Junxiao Wang ⋅ David Keyes ⋅ Di Wang
LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memory
Di Wu ⋅ Hongwei Wang ⋅ Wenhao Yu ⋅ Yuwei Zhang ⋅ Kai-Wei Chang ⋅ Dong Yu
InvestAlign: Align LLMs with Investor Decision-Making under Herd Behavior
Huisheng Wang ⋅ Zhuoshi Pan ⋅ Hangjing Zhang ⋅ Mingxiao Liu ⋅ Yiqing Lin ⋅ H. Vicky Zhao
Improving Model Merging with Natural Niches
João Abrantes ⋅ Robert Lange ⋅ Yujin Tang
Improving In-Context Learning with Small Language Model Ensembles
Mehdi Mojarradi ⋅ Lingyi Yang ⋅ Robert McCraith ⋅ Adam Mahdi
Adaptive LoRA Merging for Efficient Domain Incremental Learning
Eric Nuertey Coleman ⋅ Luigi Quarantiello ⋅ Julio Hurtado ⋅ Vincenzo Lomonaco
One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
Fabian Paischer ⋅ Lukas Hauzenberger ⋅ Thomas Schmied ⋅ Benedikt Alkin ⋅ Marc Deisenroth ⋅ Sepp Hochreiter
Embodied-RAG: General Non-parametric Embodied Memory for Retrieval and Generation
Quanting Xie ⋅ So Yeon Min ⋅ Tianyi Zhang ⋅ Kedi Xu ⋅ Aarav Bajaj ⋅ Ruslan Salakhutdinov ⋅ Matthew Johnson-Roberson ⋅ Yonatan Bisk
Slaying the HyDRA: Parameter-Efficient Hyper Networks with Low-Displacement Rank Adaptation
Xiangyu Chen ⋅ Ye Wang ⋅ Matthew Brand ⋅ Perry Wang ⋅ Jing Liu ⋅ Toshiaki Koike-Akino
Generating Diverse Negations from Affirmative Sentences
Darian Vasquez ⋅ Afroditi Papadaki
MMed-RAG: Versatile Multimodal RAG System for Medical Vision Language Models
Peng Xia ⋅ Kangyu Zhu ⋅ Haoran Li ⋅ Tianze Wang ⋅ Weijia Shi ⋅ Linjun Zhang ⋅ James Zou ⋅ Huaxiu Yao
IFCap: Image-like Retrieval and Frequency-based Entity Filtering for Zero-shot Captioning
Soeun Lee ⋅ Si-Woo Kim ⋅ taewhan Kim ⋅ Dong-Jin Kim
Retrieval-Augmented Data Augmentation for Low-Resource Domain Tasks
Minju Seo ⋅ Jinheon Baek ⋅ James Thorne ⋅ Sung Ju Hwang
$\text{Transformer}^2$: Self-adaptive LLMs
Qi Sun ⋅ Edoardo Cetin ⋅ Yujin Tang
Data-Efficient Training by Evolved Sampling
Ziheng Cheng ⋅ Zhong Li ⋅ Jiang Bian
Make-An-Agent: A Generalizable Policy Network Generator with Behavior-Prompted Diffusion
Yongyuan Liang ⋅ Tingqiang Xu ⋅ Kaizhe Hu ⋅ Guangqi Jiang ⋅ Furong Huang ⋅ Huazhe Xu
Agent Skill Acquisition for LLMs via CycleQD
So Kuroki ⋅ Taishi Nakamura ⋅ Takuya Akiba ⋅ Yujin Tang
Enhancing Low-Light Imagery: A Fusion of Deep Learning and Diffusion Models for Superior Visibility
Yangfan He ⋅ Jianhui Wang ⋅ Sida Li ⋅ Haoyuan Li ⋅ TIANYU SHI
AgentMerge: Enhancing Generalization in Fine-Tuned LLM Agents
Megh Thakkar ⋅ Léo Boisvert ⋅ Thibault de Chezelles ⋅ Alexandre Piche ⋅ Maxime Gasse ⋅ Massimo Caccia ⋅ Alexandre Lacoste
Device-Directed Speech Detection for Follow-up Conversations Using Large Language Models
Ognjen Rudovic ⋅ Pranay Dighe ⋅ Yi Su ⋅ Vineet Garg ⋅ Sameer Dharur ⋅ Xiaochuan Niu ⋅ Ahmed Abdelaziz ⋅ Saurabh Adya ⋅ Ahmed Tewfik
AoP-SAM: Automation of Prompts for Efficient Segmentation
Yi Chen ⋅ Muyoung Son ⋅ Chuanbo Hua ⋅ Joo-Young Kim
Model Developmental Safety: A Safety-Centric Method and Applications in Vision-Language Models
Gang Li ⋅ Wendi Yu ⋅ Yao Yao ⋅ Wei Tong ⋅ Yingbin Liang ⋅ Qihang Lin ⋅ Tianbao Yang
Memory Efficient Continual Learning with CLIP Models
Ryan King ⋅ Gang Li ⋅ Bobak J Mortazavi ⋅ Tianbao Yang
Empowering LLM Agents with Zero-Shot Optimal Decision-Making through Q-learning
Jiajun Chai ⋅ Sicheng Li ⋅ Yuqian Fu ⋅ Dongbin Zhao ⋅ Yuanheng Zhu
Deliberate Practice with Synthetic Data
Reyhane Askari Hemmat ⋅ Mohammad Pezeshki ⋅ Pietro Astolfi ⋅ Melissa Hall ⋅ Florian Bordes ⋅ Jakob Verbeek ⋅ Michal Drozdzal ⋅ Adriana Romero
LangDA: Adapting Visual Features with Instruction Tuning for Semantic Segmentation
Chang Liu ⋅ Saad Hossain ⋅ C Thomas ⋅ Kwei-Herng Lai ⋅ Raviteja Vemulapalli ⋅ Sirisha Rambhatla ⋅ Alexander Wong
Fine-Grained Visual Recognition in the Age of Multimodal LLMs
Hari Chandana Kuchibhotla ⋅ Abbavaram Gowtham Reddy ⋅ Sai Srinivas Kancheti ⋅ Vineeth N Balasubramanian
Transfer Learning for Finetuning Large Language Models
Tobias Strangmann ⋅ Lennart Purucker ⋅ Jörg Franke ⋅ Ivo Rapant ⋅ Fabio Ferreira ⋅ Frank Hutter
Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass
Tong Chen ⋅ Hao Fang ⋅ Patrick Xia ⋅ Xiaodong Liu ⋅ Ben Van Durme ⋅ Luke Zettlemoyer ⋅ Jianfeng Gao ⋅ Hao Cheng
Enhancing Long Context Performance in LLMs Through Inner Loop Query Mechanism
Yimin Tang ⋅ Yurong Xu ⋅ Ning Yan ⋅ Masood Seyed Mortazavi
Synergistic Weak-Strong Collaboration by Aligning Preferences
Yizhu Jiao ⋅ Xuchao Zhang ⋅ Zhaoyang Wang ⋅ Yubo Ma ⋅ Zhun Deng ⋅ Rujia Wang ⋅ Chetan Bansal ⋅ Saravan Rajmohan ⋅ Jiawei Han ⋅ Huaxiu Yao
ViPCap: Retrieval Text-based Visual Prompts for Lightweight Image Captioning
taewhan Kim ⋅ Soeun Lee ⋅ Si-Woo Kim ⋅ Dong-Jin Kim
Enhancing Cross-Language Code Translation via Task-Specific Embedding Alignment in Retrieval-Augmented Generation
Manish Bhattarai ⋅ Minh Vu ⋅ Javier E. Santos ⋅ Ismael Boureima ⋅ Daniel O'Malley
Fine-tuning LLM Agents with Retrospective In-Context Online Learning
Wen-Tse Chen ⋅ Jiayu Chen ⋅ Fahim Tajwar ⋅ Hao Zhu ⋅ Xintong Duan ⋅ Ruslan Salakhutdinov ⋅ Jeff Schneider
REGENT: A Retrieval-Augmented Generalist Agent That Can Act in-Context In New Environments
Kaustubh Sridhar ⋅ Souradeep Dutta ⋅ Dinesh Jayaraman ⋅ Insup Lee
Fast and Accurate Language Model Decoding via Parallel Token Processing
Zhepei Wei ⋅ Wei-Lin Chen ⋅ Xinyu Zhu ⋅ Yu Meng
Are LLMs Prescient? A Continuous Evaluation using Daily News as the Oracle
Amelia Hui Dai ⋅ Ryan S Teehan ⋅ Mengye Ren
Personalized Adaptation via In-Context Preference Learning
Allison Lau ⋅ Younwoo Choi ⋅ Vahid Balazadeh ⋅ Keertana Chidambaram ⋅ Vasilis Syrgkanis ⋅ Rahul Krishnan
OmniPredict: GPT-4o Enhanced Multi-modal Pedestrian Crossing Intention Prediction
Je-Seok Ham ⋅ Jia Huang ⋅ Peng Jiang ⋅ Jinyoung Moon ⋅ Yongjin Kwon ⋅ Srikanth Saripalli ⋅ Changick Kim
Common Pitfalls of Margin-based Preference Optimization in Language Model Alignment
Hui Yuan ⋅ Yifan Zeng ⋅ Yue Wu ⋅ Huazheng Wang ⋅ Mengdi Wang ⋅ Liu Leqi
Self-Play Preference Optimization for Language Model Alignment
Yue Wu ⋅ Zhiqing Sun ⋅ Huizhuo Yuan ⋅ Kaixuan Ji ⋅ Yiming Yang ⋅ Quanquan Gu
Towards Full Delegation: Designing Ideal Agentic Behaviors for Travel Planning
Song Jiang ⋅ Da JU ⋅ Andrew Cohen ⋅ Sasha Mitts ⋅ Aaron Foss ⋅ Justine Kao ⋅ Xian Li ⋅ Yuandong Tian
Optimizing Multi-Round Enhanced Training in Diffusion Models for Improved Preference Understanding
Yangfan He ⋅ Jianhui Wang ⋅ Haoyuan Li ⋅ Sida Li ⋅ Li Sun ⋅ TIANYU SHI
UniTMGE: Uniform Text-Motion Generation and Editing via Diffusion Model
Ruoyu Wang ⋅ Xiang Li ⋅ Tengjiao Sun ⋅ Yangfan He ⋅ TIANYU SHI ⋅ yitingxie
Assisted Few-Shot Learning for Vision-Language Models in Agricultural Stress Phenotype Identification
Muhammad Arbab Arshad ⋅ Talukder "Zaki" Jubery ⋅ Asheesh Singh ⋅ ARTI SINGH ⋅ Chinmay Hegde ⋅ Baskar Ganapathysubramanian ⋅ Aditya Balu ⋅ Adarsh Krishnamurthy ⋅ Soumik Sarkar
On Pre-training of Multimodal Language Models Customized for Chart Understanding
Wan-Cyuan Fan ⋅ Yen-Chun Chen ⋅ Mengchen Liu ⋅ Lu Yuan ⋅ Leonid Sigal
Controlling Multimodal LLMs via Reward-guided Decoding
Oscar Mañas ⋅ Pierluca D'Oro ⋅ Koustuv Sinha ⋅ Adriana Romero ⋅ Michal Drozdzal ⋅ Aishwarya Agrawal
Dream To Adapt: Learning Behaviors by Latent Imagination Under Non-Stationarity
Emiliyan Gospodinov ⋅ Vaisakh Shaj Kumar ⋅ Philipp Becker ⋅ Stefan Geyer ⋅ Gerhard Neumann
Sirius: Contextual Sparsity with Correction for Efficient LLM
Yang Zhou ⋅ Zhuoming Chen ⋅ Zhaozhuo Xu ⋅ Victoria Lin ⋅ Beidi Chen
Approximate Top-k for Increased Parallelism
Oscar Key ⋅ Luka Ribar ⋅ Alberto Cattaneo ⋅ Luke Hudlass-Galley ⋅ Douglas Orr
PAL: Pluralistic Alignment Framework for Learning from Heterogeneous Preferences
Daiwei Chen ⋅ Yi Chen ⋅ Aniket Rege ⋅ Ramya Korlakai Vinayak
Instant Transformer Adaption via HyperLoRA
Rujikorn Charakorn ⋅ Edoardo Cetin ⋅ Yujin Tang ⋅ Robert Lange
MMIE: Massive Multimodal Interleaved Comprehension Benchmark for Large Vision-Language Models
Peng Xia ⋅ Siwei Han ⋅ Shi Qiu ⋅ Yiyang Zhou ⋅ Zhaoyang Wang ⋅ Wenhao Zheng ⋅ Zhaorun Chen ⋅ Chenhang Cui ⋅ Mingyu Ding ⋅ Linjie Li ⋅ Lijuan Wang ⋅ Huaxiu Yao
RAGGED: Towards Informed Design of Retrieval Augmented Generation Systems
Jennifer Hsia ⋅ Afreen Shaikh ⋅ Zhiruo Wang ⋅ Graham Neubig
MagicPIG: LSH Sampling for Efficient LLM Generation
Zhuoming Chen ⋅ Ranajoy Sadhukhan ⋅ Zihao Ye ⋅ Yang Zhou ⋅ Jianyu Zhang ⋅ Niklas S Nolte ⋅ Yuandong Tian ⋅ Matthijs Douze ⋅ Leon Bottou ⋅ Zhihao Jia ⋅ Beidi Chen
Efficient Domain Adaptation of Robotic Foundation Models via Hypernetwork-Generated LoRA
Zheng Xiong ⋅ Siddhant Sharma ⋅ Kang Li ⋅ Risto Vuorio ⋅ Shimon Whiteson
NegMerge: Consensual Weight Negation for Strong Machine Unlearning
Hyoseo Kim ⋅ Dongyoon Han ⋅ Junsuk Choe
Controlling Forgetting with Test-Time Data in Continual Learning
Vaibhav Singh ⋅ Rahaf Aljundi ⋅ Eugene Belilovsky
Efficient Transfer Learning driven by Layer-wise Features Aggregation
Chanwoo Kim ⋅ Jeyoon Yeom ⋅ JOOWANG KIM ⋅ Suho Kang ⋅ Kyungwoo Song
MESS+: Energy-Optimal Inferencing in Language Model Zoos with Service Level Guarantees
Ryan Zhang ⋅ Herbert Woisetschläger ⋅ Shiqiang Wang ⋅ Hans Arno Jacobsen
Uncertainty-Penalized Direct Preference Optimization
Sam Houliston ⋅ Alizée Pace ⋅ Alexander Immer ⋅ Gunnar Rätsch
Long Context RAG Performance of Large Language Models
Quinn Leng ⋅ Jacob Portes ⋅ Samuel Havens ⋅ Matei A Zaharia ⋅ Michael Carbin
Adapting Language Models via Token Alignment
Zhili Feng ⋅ Tanya Marwah ⋅ Lester Mackey ⋅ David Alvarez-Melis ⋅ Nicolo Fusi
Exploring Visual Prompt Tuning for Demographic Adaptation in Foundation Models for Medical Imaging
Artur Parkhimchyk ⋅ Amirreza Naziri ⋅ Laleh Seyyed-Kalantari
Nexus: Specialization meets Adaptability for Efficiently Training Mixture of Experts
Nikolas Gritsch ⋅ Qizhen (Irene) Zhang ⋅ Acyr Locatelli ⋅ Sara Hooker ⋅ Ahmet Üstün
Narrow Transformer: Mono-lingual Code SLM for Desktop
Kamalkumar Rathinasamy ⋅ Balaji J ⋅ Ankush Kumar ⋅ Gagan Gayari ⋅ Harshini K ⋅ Rajab Mondal ⋅ Sreenivasa S ⋅ Swayam Singh ⋅ Mohammed Rafee Tarafdar
Combining Domain and Alignment Vectors to Achieve Better Knowledge-Safety Trade-offs in LLMs
Megh Thakkar ⋅ Yash More ⋅ Quentin Fournier ⋅ Matthew Riemer ⋅ Pin-Yu Chen ⋅ Amal Zouaq ⋅ Payel Das ⋅ Sarath Chandar
N-Gram Induction Heads for In-Context RL: Improving Stability and Reducing Data Needs
Ilya Zisman ⋅ Alexander Nikulin ⋅ Andrei Polubarov ⋅ Nikita Lyubaykin ⋅ Vladislav Kurenkov
In-Context Learning behaves as a greedy layer-wise gradient descent algorithm
Brian Chen ⋅ Tianyang Hu ⋅ Hui Jin ⋅ Hwee Lee ⋅ Kenji Kawaguchi
Dynamically Managing a Prompt Pool via Self-Enhancement in Continual Learning
Hayun Lee ⋅ Kiseong Hong ⋅ Hwanhee Lee ⋅ Sungho Suh ⋅ Eunwoo Kim
DuoDiff: Accelerating Diffusion Models with a Dual-Backbone Approach
Daniel Gallo Fernández ⋅ Răzvan-Andrei Matișan ⋅ Alejandro Monroy ⋅ Ana Vasilcoiu ⋅ Janusz Partyka ⋅ Tin Hadži Veljković ⋅ Metod Jazbec
Is In-Context Learning Sufficient for Instruction Following in LLMs?
Hao Zhao ⋅ Maksym Andriushchenko ⋅ Francesco Croce ⋅ Nicolas Flammarion
Fully-inductive Node Classification on Arbitrary Graphs
Jianan Zhao ⋅ Michael Galkin ⋅ Hesham Mostafa ⋅ Michael Bronstein ⋅ Zhaocheng Zhu ⋅ Jian Tang
Visual Language Alignment Tuning
LE ZHANG ⋅ Qian Yang ⋅ Aishwarya Agrawal
Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Merging
Joel Jang ⋅ Seungone Kim ⋅ Bill Yuchen Lin ⋅ Yizhong Wang ⋅ Jack Hessel ⋅ Luke Zettlemoyer ⋅ Hannaneh Hajishirzi ⋅ Yejin Choi ⋅ Prithviraj Ammanabrolu
Towards Conversational AI for Spina Bifida Care
Asfandyar Azhar ⋅ Shaurjya Mandal ⋅ Nidhish Shah
Informed Tree of Thought: Cost-efficient Problem Solving with Large Language Models
Sajad Mousavi ⋅ Desik Rengarajan ⋅ Ashwin Ramesh Babu ⋅ Sahand Ghorbanpour ⋅ Vineet Gundecha ⋅ Avisek Naug ⋅ Soumyendu Sarkar
Efficient Fine-Tuning of Image-Conditional Diffusion Models for Depth and Surface Normal Estimation
Gonzalo Martin Garcia ⋅ Karim Abou Zeid ⋅ Christian Schmidt ⋅ Daan de Geus ⋅ Alexander Hermans ⋅ Bastian Leibe
LinkGPT: Teaching Large Language Models To Predict Missing Links
Zhongmou He ⋅ Jing Zhu ⋅ Shengyi Qian ⋅ Joyce Chai ⋅ Danai Koutra
Extracting Parallelism from Large Language Model Queries
Steven Kolawole ⋅ Keshav Santhanam ⋅ Pratiksha Thaker ⋅ Virginia Smith
PM-Jewelry: Personalized Multimodal Adaptation for Virtual Jewelry Try-On with Latent Diffusion
Yangfan He ⋅ Yinghui Xia ⋅ Jinfeng Wei ⋅ TIANYU SHI ⋅ Yang Jingsong
CTRL-O: Language-Controllable Object-Centric Visual Representation Learning
Aniket Didolkar ⋅ Andrii Zadaianchuk ⋅ Rabiul Awal ⋅ Maximilian Seitzer ⋅ Efstratios Gavves ⋅ Aishwarya Agrawal
COrAL: Order-Agnostic Language Modeling for Efficient Iterative Refinement
Yuxi Xie ⋅ Anirudh Goyal ⋅ Xiaobao Wu ⋅ Xunjian Yin ⋅ Xiao Xu ⋅ Min-Yen Kan ⋅ Liangming Pan ⋅ William Yang Wang
Do Think Tags Really Help LLMs Plan? A Critical Evaluation of ReAct-Style Prompting
Mudit Verma ⋅ Siddhant Bhambri ⋅ Subbarao Kambhampati
SpikingVTG: Saliency Feedback Gating Enabled Spiking Video Temporal Grounding
Malyaban Bal ⋅ Brian Matejek ⋅ Susmit Jha ⋅ Adam Cobb
Domain Adaptation for Robust Model Routing
Christoph Dann ⋅ Yishay Mansour ⋅ Teodor Vanislavov Marinov ⋅ Mehryar Mohri
Automated Design of Agentic Systems
Shengran Hu ⋅ Cong Lu ⋅ Jeff Clune
Can the Spectrum of the Neural Tangent Kernel Anticipate Fine-Tuning Performance?
Zahra Rahimi Afzal ⋅ Tara Esmaeilbeig ⋅ Mojtaba Soltanalian ⋅ Mesrob I Ohannessian
Situated Instruction Following Under Ambiguous Human Intent
So Yeon Min ⋅ Xavier Puig ⋅ Devendra Singh Chaplot ⋅ Tsung-Yen Yang ⋅ Akshara Rai ⋅ Priyam Parashar ⋅ Ruslan Salakhutdinov ⋅ Yonatan Bisk ⋅ Roozbeh Mottaghi
Better Prompt Compression Without Multi-Layer Perceptrons
Edouardo Honig ⋅ Andrew Lizarraga ⋅ Zijun Frank Zhang ⋅ Ying Nian Wu
Effective Text-to-Image Alignment with Quality Aware Pair Ranking
Kunal Singh ⋅ Mukund Khanna ⋅ Pradeep Moturi
FlashDP: Memory-Efficient and High-Throughput DP-SGD Training for Large Language Models
Liangyu Wang ⋅ Junxiao Wang ⋅ Jie Ren ⋅ Zihang Xiang ⋅ David Keyes ⋅ Di Wang
GraphText: Graph Reasoning in Text Space
Jianan Zhao ⋅ Le Zhuo ⋅ Yikang Shen ⋅ Meng Qu ⋅ Kai Liu ⋅ Michael Bronstein ⋅ Zhaocheng Zhu ⋅ Jian Tang
Efficiently Learning at Test-Time: Active Fine-Tuning of LLMs
Jonas Hübotter ⋅ Sascha Bongni ⋅ Ido Hakimi ⋅ Andreas Krause
Understanding Visual Concepts Across Models
Brandon Trabucco ⋅ Max Gurinas ⋅ Kyle Doherty ⋅ Ruslan Salakhutdinov
From One to Zero: RAG-IM Adapts Language Models for Interpretable Zero-Shot Clinical Predictions
Sazan Mahbub ⋅ Caleb Ellington ⋅ Sina Alinejad ⋅ Kevin Wen ⋅ Yingtao Luo ⋅ Ben Lengerich ⋅ Eric Xing
Pick Your Influencer: Being Selective is Good for Personalization
Ashutosh Ranjan ⋅ Vivek Srivastava ⋅ Shirish Karande
Warmstarting for scaling language models
Neeratyoy Mallik ⋅ Maciej Janowski ⋅ Johannes Hog ⋅ Herilalaina Rakotoarison ⋅ Aaron Klein ⋅ Josif Grabocka ⋅ Frank Hutter
Tensor Attention Training: Provably Efficient Learning of Higher-order Transformers
Yingyu Liang ⋅ Zhenmei Shi ⋅ Zhao Song ⋅ Yufa Zhou
MD-DiT: Step-aware Mixture-of-Depths for Efficient Diffusion Transformers
Mingzhu Shen ⋅ pengtao chen ⋅ Peng Ye ⋅ Guoxuan Xia ⋅ Tao Chen ⋅ Christos Bouganis ⋅ Yiren Zhao
Towards Robust and Cost-Efficient Knowledge Unlearning for Large Language Models
Sungmin Cha ⋅ Sungjun Cho ⋅ Dasol Hwang ⋅ Moontae Lee
CITER: Collaborative Inference for Efficient Large Language Model Decoding with Token-Level Routing
Wenhao Zheng ⋅ Yixiao Chen ⋅ Weitong Zhang ⋅ Souvik Kundu ⋅ Yun Li ⋅ Zhengzhong Liu ⋅ Eric Xing ⋅ Hongyi Wang ⋅ Huaxiu Yao