Timezone: »
Decoding information from bio-signals such as EEG, using machine learning has been a challenge due to the small data-sets and difficulty to obtain labels. We propose a reconstruction-based self-supervised learning model, the masked auto-encoder for EEG (MAEEG), for learning EEG representations by learning to reconstruct the masked EEG features using a transformer architecture. We found that MAEEG can learn representations that significantly improve sleep stage classification (~5% accuracy increase) when only a small number of labels are given. We also found that input sample lengths and different ways of masking during reconstruction-based SSL pretraining have a huge effect on downstream model performance. Specifically, learning to reconstruct a larger proportion and more concentrated masked signal results in better performance on sleep classification. Our findings provide insight into how reconstruction-based SSL could help representation learning for EEG.
Author Information
Sherry Chien (Apple Inc.)
Hanlin Goh (Apple Inc.)
Christopher Sandino (Apple, Inc.)
Joseph Cheng (Stanford University)
More from the Same Authors
-
2021 : SKM-TEA: A Dataset for Accelerated MRI Reconstruction with Dense Image Labels for Quantitative Clinical Evaluation »
Arjun Desai · Andrew Schmidt · Elka Rubin · Christopher Sandino · Marianne Black · Valentina Mazzoli · Kathryn Stevens · Robert Boutin · Christopher Ré · Garry Gold · Brian Hargreaves · Akshay Chaudhari -
2022 Poster: GAUDI: A Neural Architect for Immersive 3D Scene Generation »
Miguel Angel Bautista · Pengsheng Guo · Samira Abnar · Walter Talbott · Alexander Toshev · Zhuoyuan Chen · Laurent Dinh · Shuangfei Zhai · Hanlin Goh · Daniel Ulbricht · Afshin Dehghan · Joshua Susskind -
2018 : Poster session »
David Zeng · Marzieh S. Tahaei · Shuai Chen · Felix Meister · Meet Shah · Anant Gupta · Ajil Jalal · Eirini Arvaniti · David Zimmerer · Konstantinos Kamnitsas · Pedro Ballester · Nathaniel Braman · Udaya Kumar · Sil C. van de Leemput · Junaid Qadir · Hoel Kervadec · Mohamed Akrout · Adrian Tousignant · Matthew Ng · Raghav Mehta · Miguel Monteiro · Sumana Basu · Jonas Adler · Adrian Dalca · Jizong Peng · Sungyeob Han · Xiaoxiao Li · Karthik Gopinath · Joseph Cheng · Bogdan Georgescu · Kha Gia Quach · Karthik Sarma · David Van Veen -
2018 : Oral session I »
Jonas Adler · Ajil Jalal · Joseph Cheng -
2017 : Poster session - Afternoon »
Yongchan Kwon · Young-geun Kim · Ender Konukoglu · Peter Li · John Guibas · Tejpal Virdi · Kuldeep Kumar · Morteza Mardani · Jelmer Wolterink · Enhao Gong · Natalia Antropova · Johannes Stelzer · Rene Bidart · Wei-Hung Weng · Martin Rajchl · Marc Górriz · Vineeta Singh · Christopher Sandino · Hiba Chougrad · Bob Hu · Isaac Godfried · Ke Xiao · Heliodoro Tejeda Lemus · Jordan Harrod · ILSANG WOO · Vincent Chen · Joseph Cheng · Vikash Gupta · Chuck-Hou Yee · Ben Glocker · Hervé Lombaert · Maximilian Ilse · Aneta Lisowska · Andrew Doyle · Milad Mckie -
2017 : Poster session - Morning »
Yongchan Kwon · Young-geun Kim · Ender Konukoglu · Peter Li · John Guibas · Tejpal Virdi · Kuldeep Kumar · Morteza Mardani · Jelmer Wolterink · Enhao Gong · Natalia Antropova · Johannes Stelzer · Rene Bidart · Wei-Hung Weng · Martin Rajchl · Marc Górriz · Vineeta Singh · Christopher Sandino · Hiba Chougrad · Bob Hu · Isaac Godfried · Ke Xiao · Heliodoro Tejeda Lemus · Jordan Harrod · ILSANG WOO · Vincent Chen · Joseph Cheng · Vikash Gupta · Chuck-Hou Yee · Ben Glocker · Hervé Lombaert · Maximilian Ilse · Aneta Lisowska · Andrew Doyle · Milad Mckie