Timezone: »

UniReps: Unifying Representations in Neural Models
Marco Fumero · Emanuele Rodolà · Francesco Locatello · Gintare Karolina Dziugaite · Mathilde Caron

Fri Dec 15 06:15 AM -- 06:30 AM (PST) @ Great Hall
Event URL: https://unireps.org/ »

Neural models tend to learn similar representations when subject to similar stimuli; this behavior has been observed both in biological and artificial settings.The emergence of these similar representations is igniting a growing interest in the fields of neuroscience and artificial intelligence. To gain a theoretical understanding of this phenomenon, promising directions include: analyzing the learning dynamics and studying the problem of identifiability in the functional and parameter space. This has strong consequences in unlocking a plethora of applications in ML from model fusion, model stitching, to model reuse and in improving the understanding of biological and artificial neural models. The objective of the workshop is to discuss theoretical findings, empirical evidence and practical applications of this phenomenon, benefiting from the cross-pollination of different fields (ML, Neuroscience, Cognitive Science) to foster the exchange of ideas and encourage collaborations.Overall the questions we aim to investigate are when, why and how internal representations of distinct neural models can be unified into a common representation.

Author Information

Marco Fumero (Sapienza, University of Rome)
Emanuele Rodolà (Sapienza University of Rome)
Francesco Locatello (AWS)
Gintare Karolina Dziugaite (Google Research, Brain Team)
Mathilde Caron (Google)

More from the Same Authors