Timezone: »

Continual Learning with Node-Importance based Adaptive Group Sparse Regularization
Sangwon Jung · Hongjoon Ahn · Sungmin Cha · Taesup Moon

Wed Dec 09 09:00 PM -- 11:00 PM (PST) @ Poster Session 4 #1197

We propose a novel regularization-based continual learning method, dubbed as Adaptive Group Sparsity based Continual Learning (AGS-CL), using two group sparsity-based penalties. Our method selectively employs the two penalties when learning each neural network node based on its the importance, which is adaptively updated after learning each task. By utilizing the proximal gradient descent method, the exact sparsity and freezing of the model is guaranteed during the learning process, and thus, the learner explicitly controls the model capacity. Furthermore, as a critical detail, we re-initialize the weights associated with unimportant nodes after learning each task in order to facilitate efficient learning and prevent the negative transfer. Throughout the extensive experimental results, we show that our AGS-CL uses orders of magnitude less memory space for storing the regularization parameters, and it significantly outperforms several state-of-the-art baselines on representative benchmarks for both supervised and reinforcement learning.

Author Information

Sangwon Jung (SKKU)
Hongjoon Ahn (Sunkyunkwan University)
Sungmin Cha (Sungkyunkwan University)
Taesup Moon (Sungkyunkwan University (SKKU))

Taesup Moon is currently an associate professor at Seoul National University (SNU), Korea. Prior to joining SNU in 2021, he was an associate professor at Sungkyunkwan University (SKKU) from 2017 to 2021, an assistant professor at DGIST from 2015 to 2017, a research staff member at Samsung Advanced Institute of Technology (SAIT) from 2013 to 2015, a postdoctoral researcher at UC Berkeley, Statistics from 2012 to 2013, and a research scientist at Yahoo! Labs from 2008 to 2012. He got his Ph.D. and MS degrees in Electrical Engineering from Stanford University, CA USA in 2008 and 2004, respectively, and his BS degree in Electrical Engineering from Seoul National University, Korea in 2002. His research interests are in deep learning, statistical machine learning, data science, signal processing, and information theory.

More from the Same Authors