Timezone: »
This work analyzes the robust learning problem in the multiclass setting. Under the framework of Probably Approximately Correct (PAC) learning, we first show that the graph dimension and the Natarajan dimension, which characterize the standard multiclass learnability, are no longer applicable in robust learning problem. We then generalize these notions to the robust learning setting, denoted as the adversarial graph dimension (AG-dimension) and the adversarial Natarajan dimension (AN-dimension). Upper and lower bounds of the sample complexity of robust multiclass learning are rigorously derived based on the AG-dimension and AN-dimension, respectively. Moreover, we calculate the AG-dimension and AN-dimension of the class of linear multiclass predictors, and show that the graph (Natarajan) dimension is of the same order as the AG(AN)-dimension. Finally, we prove that the AG-dimension and AN-dimension are not equivalent.
Author Information
Jingyuan Xu (Wuhan University)
Weiwei Liu (Wuhan University)
More from the Same Authors
-
2022 Poster: Defending Against Adversarial Attacks via Neural Dynamic System »
Xiyuan Li · Zou Xin · Weiwei Liu -
2022 Poster: On the Tradeoff Between Robustness and Fairness »
Xinsong Ma · Zekai Wang · Weiwei Liu -
2019 Poster: Copula Multi-label Learning »
Weiwei Liu -
2017 Poster: Sparse Embedded $k$-Means Clustering »
Weiwei Liu · Xiaobo Shen · Ivor Tsang -
2015 Poster: On the Optimality of Classifier Chain for Multi-label Classification »
Weiwei Liu · Ivor Tsang