Timezone: »
Dimensionality reduction is often needed in many applications due to the high dimensionality of the data involved. In this paper, we first analyze the scatter measures used in the conventional linear discriminant analysis~(LDA) model and note that the formulation is based on the average-case view. Based on this analysis, we then propose a new dimensionality reduction method called worst-case linear discriminant analysis~(WLDA) by defining new between-class and within-class scatter measures. This new model adopts the worst-case view which arguably is more suitable for applications such as classification. When the number of training data points or the number of features is not very large, we relax the optimization problem involved and formulate it as a metric learning problem. Otherwise, we take a greedy approach by finding one direction of the transformation at a time. Moreover, we also analyze a special case of WLDA to show its relationship with conventional LDA. Experiments conducted on several benchmark datasets demonstrate the effectiveness of WLDA when compared with some related dimensionality reduction methods.
Author Information
Yu Zhang (Hong Kong Baptist University)
Dit-Yan Yeung (Hong Kong University of Science and Technology)
More from the Same Authors
-
2017 Poster: Deep Learning for Precipitation Nowcasting: A Benchmark and A New Model »
Xingjian Shi · Zhihan Gao · Leonard Lausen · Hao Wang · Dit-Yan Yeung · Wai-kin Wong · Wang-chun WOO -
2017 Spotlight: Deep Learning for Precipitation Nowcasting: A Benchmark and A New Model »
Xingjian Shi · Zhihan Gao · Leonard Lausen · Hao Wang · Dit-Yan Yeung · Wai-kin Wong · Wang-chun WOO -
2016 Poster: Natural-Parameter Networks: A Class of Probabilistic Neural Networks »
Hao Wang · Xingjian SHI · Dit-Yan Yeung -
2016 Poster: Collaborative Recurrent Autoencoder: Recommend while Learning to Fill in the Blanks »
Hao Wang · Xingjian SHI · Dit-Yan Yeung -
2015 Poster: Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting »
Xingjian Shi · Zhourong Chen · Hao Wang · Dit-Yan Yeung · Wai-kin Wong · Wang-chun WOO -
2013 Poster: Learning a Deep Compact Image Representation for Visual Tracking »
Naiyan Wang · Dit-Yan Yeung -
2013 Poster: Heterogeneous-Neighborhood-based Multi-Task Local Learning Algorithms »
Yu Zhang -
2012 Poster: Co-Regularized Hashing for Multimodal Data »
Yi Zhen · Dit-Yan Yeung -
2010 Poster: Probabilistic Multi-Task Feature Selection »
Yu Zhang · Dit-Yan Yeung · Qian Xu -
2009 Poster: Probabilistic Relational PCA »
Wu-Jun Li · Dit-Yan Yeung · Zhihua Zhang -
2009 Spotlight: Probabilistic Relational PCA »
Wu-Jun Li · Dit-Yan Yeung · Zhihua Zhang -
2008 Poster: Posterior Consistency of the Silverman g-prior in Bayesian Model Choice »
Zhihua Zhang · Michael Jordan · Dit-Yan Yeung -
2008 Spotlight: Posterior Consistency of the Silverman g-prior in Bayesian Model Choice »
Zhihua Zhang · Michael Jordan · Dit-Yan Yeung