Timezone: »
A Comparative Survey of Deep Active Learning
Xueying Zhan · Qingzhong Wang · Kuan-Hao Huang · Haoyi Xiong · Dejing Dou · Antoni Chan
While deep learning (DL) is data-hungry and usually relies on extensive labeled data to deliver good performance, Active Learning (AL) reduces labeling costs by selecting a small proportion of samples from unlabeled data for labeling and training. Therefore, Deep Active Learning (DAL) has risen as a feasible solution for maximizing model performance under a limited labeling cost/budget in recent years. Abundant DAL methods and various literature reviews have been developed and conducted. In this work, we survey and categorize DAL-related works and construct comparative experiments across $10$ frequently used image classification datasets and $19$ DAL algorithms based on \emph{$\text{DeepAL}^+$} toolbox. Our work is the largest comparative study to date. Additionally, we explore some factors (e.g., batch size, number of epochs in the training process) that influence the efficacy of DAL, which provides better references for researchers to design their DAL experiments or carry out DAL-related applications.
Author Information
Xueying Zhan (City University of Hong Kong)
Qingzhong Wang (Baidu)
Kuan-Hao Huang (University of California, Los Angeles)
Haoyi Xiong
Dejing Dou (Baidu)
Antoni Chan (City University of Hong Kong)
More from the Same Authors
-
2022 Poster: Generative Time Series Forecasting with Diffusion, Denoise, and Disentanglement »
Yan Li · Xinjiang Lu · Yaqing Wang · Dejing Dou -
2022 Poster: InterpretDL: Explaining Deep Models in PaddlePaddle »
Xuhong Li · Haoyi Xiong · Xingjian Li · Xuanyu Wu · Zeyu Chen · Dejing Dou -
2022 : An Empirical Study on Distribution Shift Robustness From the Perspective of Pre-Training and Data Augmentation »
Ziquan Liu · Yi Xu · Yuanhong Xu · Qi Qian · Hao Li · Rong Jin · Xiangyang Ji · Antoni Chan -
2022 : SMILE: Sample-to-feature MIxup for Efficient Transfer LEarning »
Xingjian Li · Haoyi Xiong · Cheng-Zhong Xu · Dejing Dou -
2022 : Precise Augmentation and Counting of Helicobacter Pylori in Histology Image »
· Yixin Chen · Zhifeng Shuai · Fang Peng · Yanbo Lv · Luoning Zheng · Xue (Steve) Liu · Antoni Chan · Tei-Wei Kuo · Chun Jason XUE -
2022 : A Simple Framework for Active Learning to Rank »
Qingzhong Wang · Haifang Li · Haoyi Xiong · Wen Wang · Jiang Bian · Yu Lu · Shuaiqiang Wang · zhicong cheng · Dawei Yin · Dejing Dou -
2022 Spotlight: Lightning Talks 1B-4 »
Andrei Atanov · Shiqi Yang · Wanshan Li · Yongchang Hao · Ziquan Liu · Jiaxin Shi · Anton Plaksin · Jiaxiang Chen · Ziqi Pan · yaxing wang · Yuxin Liu · Stepan Martyanov · Alessandro Rinaldo · Yuhao Zhou · Li Niu · Qingyuan Yang · Andrei Filatov · Yi Xu · Liqing Zhang · Lili Mou · Ruomin Huang · Teresa Yeo · kai wang · Daren Wang · Jessica Hwang · Yuanhong Xu · Qi Qian · Hu Ding · Michalis Titsias · Shangling Jui · Ajay Sohmshetty · Lester Mackey · Joost van de Weijer · Hao Li · Amir Zamir · Xiangyang Ji · Antoni Chan · Rong Jin -
2022 Spotlight: InterpretDL: Explaining Deep Models in PaddlePaddle »
Xuhong Li · Haoyi Xiong · Xingjian Li · Xuanyu Wu · Zeyu Chen · Dejing Dou -
2022 Spotlight: Improved Fine-Tuning by Better Leveraging Pre-Training Data »
Ziquan Liu · Yi Xu · Yuanhong Xu · Qi Qian · Hao Li · Xiangyang Ji · Antoni Chan · Rong Jin -
2022 Spotlight: Lightning Talks 1A-1 »
Siba Smarak Panigrahi · Xuhong Li · Mikhail Usvyatsov · Shaohan Chen · Sohan Patnaik · Haoyi Xiong · Nikolaos V Sahinidis · Rafael Ballester-Ripoll · Chuanhou Gao · Xingjian Li · Konrad Schindler · Xuanyu Wu · Zeyu Chen · Dejing Dou -
2022 Poster: AutoMS: Automatic Model Selection for Novelty Detection with Error Rate Control »
Yifan Zhang · Haiyan Jiang · Haojie Ren · Changliang Zou · Dejing Dou -
2022 Poster: Improved Fine-Tuning by Better Leveraging Pre-Training Data »
Ziquan Liu · Yi Xu · Yuanhong Xu · Qi Qian · Hao Li · Xiangyang Ji · Antoni Chan · Rong Jin -
2021 : [O6] Explaining Information Flow Inside Vision Transformers Using Markov Chain »
Tingyi Yuan · Xuhong Li · Haoyi Xiong · Dejing Dou -
2020 Poster: Modeling Noisy Annotations for Crowd Counting »
Jia Wan · Antoni Chan -
2020 Poster: Discriminative Sounding Objects Localization via Self-supervised Audiovisual Matching »
Di Hu · Rui Qian · Minyue Jiang · Xiao Tan · Shilei Wen · Errui Ding · Weiyao Lin · Dejing Dou -
2017 Poster: Incorporating Side Information by Adaptive Convolution »
Di Kang · Debarun Dhar · Antoni Chan -
2012 Poster: The variational hierarchical EM algorithm for clustering hidden Markov models. »
Emanuele Coviello · Antoni Chan · Gert Lanckriet