Timezone: »
Sparse-Group Lasso (SGL) has been shown to be a powerful regression technique for simultaneously discovering group and within-group sparse patterns by using a combination of the l1 and l2 norms. However, in large-scale applications, the complexity of the regularizers entails great computational challenges. In this paper, we propose a novel two-layer feature reduction method (TLFre) for SGL via a decomposition of its dual feasible set. The two-layer reduction is able to quickly identify the inactive groups and the inactive features, respectively, which are guaranteed to be absent from the sparse representation and can be removed from the optimization. Existing feature reduction methods are only applicable for sparse models with one sparsity-inducing regularizer. To our best knowledge, TLFre is the first one that is capable of dealing with multiple sparsity-inducing regularizers. Moreover, TLFre has a very low computational cost and can be integrated with any existing solvers. Experiments on both synthetic and real data sets show that TLFre improves the efficiency of SGL by orders of magnitude.
Author Information
Jie Wang (Arizona State University)
Jieping Ye (Arizona State University)
Related Events (a corresponding poster, oral, or spotlight)
-
2014 Poster: Two-Layer Feature Reduction for Sparse-Group Lasso via Decomposition of Convex Sets »
Wed. Dec 10th 12:00 -- 04:59 AM Room Level 2, room 210D
More from the Same Authors
-
2014 Poster: A Safe Screening Rule for Sparse Logistic Regression »
Jie Wang · Jiayu Zhou · Jun Liu · Peter Wonka · Jieping Ye -
2013 Poster: Lasso Screening Rules via Dual Polytope Projection »
Jie Wang · Jiayu Zhou · Peter Wonka · Jieping Ye -
2013 Spotlight: Lasso Screening Rules via Dual Polytope Projection »
Jie Wang · Jiayu Zhou · Peter Wonka · Jieping Ye -
2012 Poster: Multi-Stage Multi-Task Feature Learning »
Pinghua Gong · Jieping Ye · Changshui Zhang -
2012 Poster: Multi-task Vector Field Learning »
Binbin Lin · Sen Yang · Chiyuan Zhang · Jieping Ye · Xiaofei He -
2012 Spotlight: Multi-Stage Multi-Task Feature Learning »
Pinghua Gong · Jieping Ye · Changshui Zhang -
2012 Poster: Generalization Bounds for Domain Adaptation »
Chao Zhang · Jieping Ye · Lei Zhang -
2011 Poster: Clustered Multi-Task Learning Via Alternating Structure Optimization »
Jiayu Zhou · Jianhui Chen · Jieping Ye -
2011 Poster: Efficient Methods for Overlapping Group Lasso »
Lei Yuan · Jun Liu · Jieping Ye -
2011 Poster: Projection onto A Nonnegative Max-Heap »
Jun Liu · Liang Sun · Jieping Ye -
2011 Spotlight: Projection onto A Nonnegative Max-Heap »
Jun Liu · Liang Sun · Jieping Ye -
2011 Poster: A Two-Stage Weighting Framework for Multi-Source Domain Adaptation »
Qian Sun · Rita Chattopadhyay · Sethuraman Panchanathan · Jieping Ye -
2011 Poster: Identifying Alzheimer's Disease-Related Brain Regions from Multi-Modality Neuroimaging Data using Sparse Composite Linear Discrimination Analysis »
Shuai Huang · Jing Li · Jieping Ye · Teresa Wu · Kewei Chen · Adam Fleisher · Eric Reiman -
2011 Spotlight: Identifying Alzheimer's Disease-Related Brain Regions from Multi-Modality Neuroimaging Data using Sparse Composite Linear Discrimination Analysis »
Shuai Huang · Jing Li · Jieping Ye · Teresa Wu · Kewei Chen · Adam Fleisher · Eric Reiman -
2010 Poster: Moreau-Yosida Regularization for Grouped Tree Structure Learning »
Jun Liu · Jieping Ye -
2010 Poster: Multi-Stage Dantzig Selector »
Ji Liu · Peter Wonka · Jieping Ye -
2009 Poster: Learning Brain Connectivity of Alzheimer's Disease from Neuroimaging Data »
Shuai Huang · Jing Li · Liang Sun · Jun Liu · Teresa Wu · Kewei Chen · Adam Fleisher · Eric Reiman · Jieping Ye -
2009 Spotlight: Learning Brain Connectivity of Alzheimer's Disease from Neuroimaging Data »
Shuai Huang · Jing Li · Liang Sun · Jun Liu · Teresa Wu · Kewei Chen · Adam Fleisher · Eric Reiman · Jieping Ye -
2009 Poster: Efficient Recovery of Jointly Sparse Vectors »
Liang Sun · Jun Liu · Jianhui Chen · Jieping Ye -
2008 Poster: Multi-label Multiple Kernel Learning »
Shuiwang Ji · Liang Sun · Rong Jin · Jieping Ye -
2008 Spotlight: Multi-label Multiple Kernel Learning »
Shuiwang Ji · Liang Sun · Rong Jin · Jieping Ye -
2007 Poster: Discriminative K-means for Clustering »
Jieping Ye · Zheng Zhao · Mingrui Wu