Timezone: »
Poster
Asymptotically Unbiased Instance-wise Regularized Partial AUC Optimization: Theory and Algorithm
HuiYang Shao · Qianqian Xu · Zhiyong Yang · Shilong Bao · Qingming Huang
@
The Partial Area Under the ROC Curve (PAUC), typically including One-way Partial AUC (OPAUC) and Two-way Partial AUC (TPAUC), measures the average performance of a binary classifier within a specific false positive rate and/or true positive rate interval, which is a widely adopted measure when decision constraints must be considered. Consequently, PAUC optimization has naturally attracted increasing attention in the machine learning community within the last few years. Nonetheless, most of the existing methods could only optimize PAUC approximately, leading to inevitable biases that are not controllable. Fortunately, a recent work presents an unbiased formulation of the PAUC optimization problem via distributional robust optimization. However, it is based on the pair-wise formulation of AUC, which suffers from the limited scalability w.r.t. sample size and a slow convergence rate, especially for TPAUC. To address this issue, we present a simpler reformulation of the problem in an asymptotically unbiased and instance-wise manner. For both OPAUC and TPAUC, we come to a nonconvex strongly concave min-max regularized problem of instance-wise functions. On top of this, we employ an efficient solver that enjoys a linear per-iteration computational complexity w.r.t. the sample size and a time-complexity of $O(\epsilon^{-1/3})$ to reach a $\epsilon$ stationary point. Furthermore, we find that the min-max reformulation also facilitates the theoretical analysis of generalization error as a byproduct. Compared with the existing results, we present new error bounds that are much easier to prove and could deal with hypotheses with real-valued outputs. Finally, extensive experiments on several benchmark datasets demonstrate the effectiveness of our method.
Author Information
HuiYang Shao (University of the Chinese Academy of Sciences)
Qianqian Xu (Key Laboratory of Intelligent Information Processing, Institute of Computing Technology, Chinese Academy of Sciences)
Zhiyong Yang (Chinese Academy of Sciences)
Shilong Bao (University of the Chinese Academy of Sciences)
Qingming Huang (University of Chinese Academy of Sciences)
More from the Same Authors
-
2022 Poster: Exploring the Algorithm-Dependent Generalization of AUPRC Optimization with List Stability »
Peisong Wen · Qianqian Xu · Zhiyong Yang · Yuan He · Qingming Huang -
2023 Poster: DRAUC: An Instance-wise Distributionally Robust AUC Optimization Framework »
Siran Dai · Qianqian Xu · Zhiyong Yang · Xiaochun Cao · Qingming Huang -
2023 Poster: Weighted ROC Curve in Cost Space: Extending AUC to Cost-Sensitive Learning »
HuiYang Shao · Qianqian Xu · Zhiyong Yang · Peisong Wen · Gao Peifeng · Qingming Huang -
2023 Poster: A Unified Generalization Analysis of Re-Weighting and Logit-Adjustment for Imbalanced Learning »
Zitai Wang · Qianqian Xu · Zhiyong Yang · Yuan He · Xiaochun Cao · Qingming Huang -
2022 Spotlight: OpenAUC: Towards AUC-Oriented Open-Set Recognition »
Zitai Wang · Qianqian Xu · Zhiyong Yang · Yuan He · Xiaochun Cao · Qingming Huang -
2022 Panel: Panel 2C-8: The Minority Matters:… & Motion Transformer with… »
Shaoshuai Shi · Shilong Bao -
2022 Poster: OpenAUC: Towards AUC-Oriented Open-Set Recognition »
Zitai Wang · Qianqian Xu · Zhiyong Yang · Yuan He · Xiaochun Cao · Qingming Huang -
2022 Poster: OTKGE: Multi-modal Knowledge Graph Embeddings via Optimal Transport »
Zongsheng Cao · Qianqian Xu · Zhiyong Yang · Yuan He · Xiaochun Cao · Qingming Huang -
2022 Poster: The Minority Matters: A Diversity-Promoting Collaborative Metric Learning Algorithm »
Shilong Bao · Qianqian Xu · Zhiyong Yang · Yuan He · Xiaochun Cao · Qingming Huang -
2021 Poster: When False Positive is Intolerant: End-to-End Optimization with Low FPR for Multipartite Ranking »
Peisong Wen · Qianqian Xu · Zhiyong Yang · Yuan He · Qingming Huang -
2020 Poster: Heuristic Domain Adaptation »
Shuhao Cui · Xuan Jin · Shuhui Wang · Yuan He · Qingming Huang -
2019 Poster: Generalized Block-Diagonal Structure Pursuit: Learning Soft Latent Task Assignment against Negative Transfer »
Zhiyong Yang · Qianqian Xu · Yangbangyan Jiang · Xiaochun Cao · Qingming Huang -
2019 Poster: DM2C: Deep Mixed-Modal Clustering »
Yangbangyan Jiang · Qianqian Xu · Zhiyong Yang · Xiaochun Cao · Qingming Huang -
2019 Spotlight: DM2C: Deep Mixed-Modal Clustering »
Yangbangyan Jiang · Qianqian Xu · Zhiyong Yang · Xiaochun Cao · Qingming Huang -
2019 Poster: iSplit LBI: Individualized Partial Ranking with Ties via Split LBI »
Qianqian Xu · Xinwei Sun · Zhiyong Yang · Xiaochun Cao · Qingming Huang · Yuan Yao