Skip to yearly menu bar Skip to main content


Workshop

4th Workshop on Self-Supervised Learning: Theory and Practice

Tengda Han ⋅ Ishan Misra ⋅ Pengtao Xie ⋅ Mathilde Caron ⋅ Hilde Kuehne ⋅ Xingjian Bai ⋅ Vadim Tschernezki
Project Page

Abstract

Video

Chat is not available.

Schedule

Timezone: America/Los_Angeles
7:15 AM
Yuki M Asano
7:45 AM
Diane Larlus
8:15 AM
Alyosha Efros
9:00 AM
Abhinav Gupta
9:30 AM
Chelsea Finn
10:00 AM
Poster Session I
12:15 PM
Xinyun Chen
Improving Domain Generalization in Contrastive Learning Using Adaptive Temperature Control
Katie Matton ⋅ Robert Lewis ⋅ Rosalind Picard ⋅ John Guttag
Visualizing the loss landscape of Self-supervised Vision Transformer
Youngwan Lee ⋅ Jeffrey Willette ⋅ Jonghee Kim ⋅ Sung Ju Hwang
Evolving Graph Generalization Estimation via Self-Supervised Learning
Bin Lu ⋅ Tingyan Ma ⋅ Xiaoying Gan ⋅ Luoyi Fu ⋅ Xinbing Wang ⋅ Chenghu Zhou ⋅ Shiyu Liang
WERank: Rank Degradation Prevention for Self-Supervised Learning via Weight Regularization
Ali Saheb Pasand ⋅ Reza Moravej ⋅ Mahdi Biparva ⋅ Ali Ghodsi
Language-Conditioned Semantic Search-Based Policy for Robotic Manipulation Tasks
Jannik Sheikh ⋅ Andrew Melnik ⋅ Gora Chand Nandi ⋅ Robert Haschke
MeSa: Masked, Geometric, and Supervised Pre-training for Monocular Depth Estimation
Muhammad Osama Khan ⋅ Junbang Liang ⋅ Chun-Kai Wang ⋅ Shan Yang ⋅ Yu Lou
DAPO: Self-Supervised Domain Adaptation for 6DoF Pose Estimation
Juseong Jin ⋅ Eunju Jeong ⋅ Joonmyun Cho ⋅ JUN HEE PARK ⋅ Young-Gon Kim
Self-Supervised Learning Meets Liver Ultrasound Imaging
Abder-Rahman Ali, PhD ⋅ Anthony E Samir
No Free Lunch in Self Supervised Representation Learning
Ihab Bendidi ⋅ Adrien Bardes ⋅ ethan cohen ⋅ Alexis Lamiable ⋅ Guillaume Bollot ⋅ Auguste Genovesio
MOFO: MOtion FOcused Self-Supervision for Video Understanding
Mona Ahmadian ⋅ Frank Guerin ⋅ Andrew Gilbert
Learning to Embed Time Series Patches Independently
Seunghan Lee ⋅ Taeyoung Park ⋅ Kibok Lee
Unsupervised Segmentation of Colonoscopy Images
Heming Yao ⋅ Jérôme Lüscher ⋅ Benjamin Gutierrez Becker ⋅ Josep Arús-Pous ⋅ Tommaso Biancalani ⋅ Amelie Bigorgne ⋅ David Richmond
Enhancing CLIP with a Third Modality
Efthymios Tsaprazlis ⋅ Georgios Smyrnis ⋅ Alex Dimakis ⋅ Petros Maragos
Generalization properties of contrastive world models
Kandan Ramakrishnan ⋅ R. James Cotton ⋅ Xaq Pitkow ⋅ Andreas Tolias
How does semi-supervised learning with pseudo-labelers work? A case study
Yiwen Kou ⋅ Zixiang Chen ⋅ Yuan Cao ⋅ Quanquan Gu
Ring Attention with Blockwise Transformers for Near-Infinite Context
Hao Liu ⋅ Matei A Zaharia ⋅ Pieter Abbeel
Soft Contrastive Learning for Time Series
Seunghan Lee ⋅ Taeyoung Park ⋅ Kibok Lee
Language Model Training Paradigms for Clinical Feature Embeddings
Yurong Hu ⋅ Manuel Burger ⋅ Gunnar Rätsch ⋅ Rita Kuznetsova
Structuring Representation Geometry with Rotationally Equivariant Contrastive Learning
Sharut Gupta ⋅ Joshua Robinson ⋅ Derek Lim ⋅ Soledad Villar ⋅ Stefanie Jegelka
Multimodal Distillation of CLIP Models
Georgios Smyrnis ⋅ Sriram Ravula ⋅ Sujay Sanghavi ⋅ Alex Dimakis
Augmentation matters: Representation learning for Strong Gravitational lensing
Kuan-Wei Huang ⋅ Po-Wen Chang ⋅ Joshua Fagin ⋅ James Chan ⋅ Joshua Yao-Yu Lin
Online Feature Updates Improve Online (Generalized) Label Shift Adaptation
Ruihan Wu ⋅ Siddhartha Datta ⋅ Yi Su ⋅ Dheeraj Baby ⋅ Yu-Xiang Wang ⋅ Kilian Weinberger
FroSSL: Frobenius Norm Minimization for Self-Supervised Learning
Oscar Skean ⋅ Aayush Dhakal ⋅ Nathan Jacobs ⋅ Luis Sanchez Giraldo
Spectral Temporal Contrastive Learning
Sacha Morin ⋅ Somjit Nath ⋅ Samira Ebrahimi Kahou ⋅ Guy Wolf
Exploring Target Representations for Masked Autoencoders
xingbin liu ⋅ Jinghao Zhou ⋅ Tao Kong
Non-Vacuous Generalization Bounds for Large Language Models
Sanae Lotfi ⋅ Marc Finzi ⋅ Yilun Kuang ⋅ Tim G. J. Rudner ⋅ Micah Goldblum ⋅ Andrew Wilson
Bootstrap Your Own Variance
Polina Turishcheva ⋅ Jason Ramapuram ⋅ Sinead Williamson ⋅ Dan Busbridge ⋅ Eeshan Gunesh Dhekane ⋅ Russell Webb
Self-supervised Representation Learning from Random Data Projectors
Yi Sui ⋅ Tongzi Wu ⋅ Jesse Cresswell ⋅ Ga Wu ⋅ George Stein ⋅ Xiao Shi Huang ⋅ Xiaochen Zhang ⋅ Maksims Volkovs
An Information-Theoretic Understanding of Maximum Manifold Capacity Representations
Berivan Isik ⋅ Rylan Schaeffer ⋅ Victor Lecomte ⋅ Mikail Khona ⋅ Yann LeCun ⋅ Sanmi Koyejo ⋅ Andrey Gromov ⋅ Ravid Shwartz-Ziv
Self-Distilled Representation Learning for Time Series
Felix Pieper ⋅ Konstantin Ditschuneit ⋅ Martin Genzel ⋅ Alexandra Lindt ⋅ Johannes Otterbach
Making Self-supervised Learning Robust to Spurious Correlation via Learning-speed Aware Sampling
Weicheng Zhu ⋅ Sheng Liu ⋅ Carlos Fernandez-Granda ⋅ Narges Razavian
Generalized Category Discovery with Hierarchical Label Smoothing
Sarah Rastegar ⋅ Yuki M Asano ⋅ Hazel Doughty ⋅ Cees Snoek
Benchmarking self-supervised video representation learning
Akash Kumar ⋅ Ashlesha Kumar ⋅ Vibhav Vineet ⋅ Yogesh Rawat
Neurosymbolic Grounding for Compositional Generalization
Atharva Sehgal ⋅ Arya Grayeli ⋅ Jennifer J Sun ⋅ Swarat Chaudhuri
No Representation Rules Them All in Category Discovery
Sagar Vaze ⋅ Andrea Vedaldi ⋅ Andrew Zisserman
Application of Self Supervised Vision Transformers for Multiplexed Microscopy Images and Its Challenges
Gantugs Atarsaikhan ⋅ Isabel Mogollon ⋅ Katja Välimäki ⋅ Teijo Pellinen ⋅ Tuomas Mirtti ⋅ Lassi Paavolainen
HyperMAE: Modulating Implicit Neural Representations for MAE Training
Varun Belagali ⋅ Lei Zhou ⋅ Xiang Li ⋅ Dimitris Samaras
Identifiable attribution maps using regularized contrastive learning
Steffen Schneider ⋅ Rodrigo González Laiz ⋅ Markus Frey ⋅ Mackenzie Mathis
On Improving the Sample Efficiency of Non-Contrastive SSL
Kumar Krishna Agrawal ⋅ Arna Ghosh ⋅ Adam Oberman ⋅ Blake Richards
On the Varied Faces of Overparameterization in Supervised and Self-Supervised Learning
Matteo Gamba ⋅ Arna Ghosh ⋅ Kumar Krishna Agrawal ⋅ Blake Richards ⋅ Hossein Azizpour ⋅ Mårten Björkman
Learning Useful Representations of Recurrent Neural Network Weight Matrices
Vincent Herrmann ⋅ Francesco Faccio ⋅ Jürgen Schmidhuber
MolSiam: Simple Siamese Self-supervised Representation Learning for Small Molecules
Joshua Yao-Yu Lin ⋅ Michael Maser ⋅ Nathan Frey ⋅ Gabriele Scalia ⋅ Omar Mahmood ⋅ Pedro O. Pinheiro ⋅ Ji Won Park ⋅ Stephen Ra ⋅ Andrew Watkins ⋅ Kyunghyun Cho
Self-Supervised Disentanglement by Leveraging Structure in Data Augmentations
Cian Eastwood ⋅ Julius von Kügelgen ⋅ Linus Ericsson ⋅ Diane Bouchacourt ⋅ Pascal Vincent ⋅ Bernhard Schölkopf ⋅ Mark Ibrahim
Self-supervised Learning for User Sequence Modeling
Yuhan Liu ⋅ Lin Ning ⋅ Neo Wu ⋅ Karan Singhal ⋅ Philip Mansfield ⋅ Devora Berlowitz ⋅ Bradley Green
LiDAR: Sensing Linear Probing Performance in Joint Embedding SSL Architectures
Vimal Thilak ⋅ Chen Huang ⋅ Omid Saremi ⋅ Laurent Dinh ⋅ Hanlin Goh ⋅ Preetum Nakkiran ⋅ Joshua Susskind ⋅ Etai Littwin
Multi-Task Learning with Self-Supervised Objectives can Improve Worst-Group Outcomes
Atharva Kulkarni ⋅ Lucio M Dery ⋅ Amrith Setlur ⋅ Aditi Raghunathan ⋅ Ameet Talwalkar ⋅ Graham Neubig
Can semi-supervised learning use all the data effectively? A lower bound perspective
Alexandru Tifrea ⋅ Gizem Yüce ⋅ Amartya Sanyal ⋅ Fanny Yang
Simple Contrastive Representation Learning for Time Series Forecasting
Xiaochen Zheng ⋅ Xingyu Chen ⋅ Manuel Schürch ⋅ Maolaaisha Aminanmu ⋅ Ahmed Allam ⋅ Michael Krauthammer
Iterated Piecewise Affine (IPA) Approximation for Language Modeling
Davood Shamsi ⋅ Wen-yu Hua ⋅ Brian Williams
Understanding Self-Supervised Features for Learning Unsupervised Instance Segmentation
Paul Engstler ⋅ Luke Melas-Kyriazi ⋅ Christian Rupprecht ⋅ Iro Laina
Zero-shot Clustering of Embeddings with Self-Supervised Learnt Encoders
Scott C. Lowe ⋅ Joakim Bruslund Haurum ⋅ Sageev Oore ⋅ Thomas Moeslund ⋅ Graham Taylor
SurgMAE: Masked Autoencoders for Long Surgical Video Analysis
Muhammad Abdullah Jamal ⋅ Omid Mohareri
Bridging State and History Representations: Understanding Self-Predictive RL
Tianwei Ni ⋅ Benjamin Eysenbach ⋅ Erfan Seyedsalehi ⋅ Michel Ma ⋅ Clement Gehring ⋅ Aditya Mahajan ⋅ Pierre-Luc Bacon
Augmentation-aware Self-Supervised Learning with Conditioned Projector
Marcin Przewięźlikowski ⋅ Mateusz Pyla ⋅ Bartosz Zieliński ⋅ Bartłomiej Twardowski ⋅ Jacek Tabor ⋅ Marek Śmieja
BarcodeBERT: Transformers for Biodiversity Analysis
Pablo Millan Arias ⋅ Niousha Sadjadi ⋅ Monireh Safari ⋅ ZeMing Gong ⋅ Austin T. Wang ⋅ Scott C. Lowe ⋅ Joakim Bruslund Haurum ⋅ Iuliia Eyriay ⋅ Dirk Steinke ⋅ Lila Kari ⋅ Angel Chang ⋅ Graham Taylor