Skip to yearly menu bar Skip to main content


(3 events)   Timezone:  
Show all
Toggle Poster Visibility
San Diego Oral
Thu Dec 04 03:30 PM -- 03:50 PM (PST) @ Exhibit Hall F,G,H None
A is for Absorption: Studying Feature Splitting and Absorption in Sparse Autoencoders
In Oral 4A Language Model 2
David Chanin · James Wilken-Smith · Tomáš Dulka · Hardik Bhatnagar · Satvik Golechha · Joseph Bloom
[ OpenReview] 
San Diego Oral
Thu Dec 04 03:50 PM -- 04:10 PM (PST) @ Exhibit Hall F,G,H None
Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free
In Oral 4A Language Model 2
Zihan Qiu · Zekun Wang · Bo Zheng · Zeyu Huang · Kaiyue Wen · Songlin Yang · Rui Men · Le Yu · Fei Huang · Suozhi Huang · Dayiheng Liu · Jingren Zhou · Junyang Lin
[ OpenReview] 
San Diego Oral
Thu Dec 04 04:10 PM -- 04:30 PM (PST) @ Exhibit Hall F,G,H None
Superposition Yields Robust Neural Scaling
In Oral 4A Language Model 2
Yizhou Liu · Ziming Liu · Jeff Gore
[ OpenReview]