In-person presentation
in
Workshop: Attributing Model Behavior at Scale (ATTRIB)

What does scale give us: Why we are building a ladder to the moon (Sara Hooker)

2023 In-person presentation
in
Workshop: Attributing Model Behavior at Scale (ATTRIB)

Abstract

A talk about what we know about the role of scale at conferring valuable generalization properties. I will present some background, some of our work on understanding the role of scale (both of data and model size) and some thoughts about how we can get away from the painfully inefficient formula of just scaling capacity.

Video

Chat is not available.