Timezone: »
Recently, unsupervised adversarial training (AT) has been extensively studied to attain robustness with the models trained upon unlabeled data. To this end, previous studies have applied existing supervised adversarial training techniques to self-supervised learning (SSL) frameworks. However, all have resorted to untargeted adversarial learning as obtaining targeted adversarial examples is unclear in the SSL setting lacking of label information. In this paper, we propose a novel targeted adversarial training method for the SSL frameworks. Specifically, we propose a target selection algorithm for the adversarial SSL frameworks; it is designed to select the most confusing sample for each given instance based on similarity and entropy, and perturb the given instance toward the selected target sample. Our method is readily applicable to general SSL frameworks that only uses positive pairs. We validate our method on benchmark datasets, on which it obtains superior robust accuracies, outperforming existing unsupervised adversarial training methods.
Author Information
Minseon Kim (KAIST)
Hyeonjeong Ha (KAIST)
Sooel Son (Korea Advanced Institute of Science and Technology)
Sung Ju Hwang (KAIST, AITRICS)
More from the Same Authors
-
2022 Poster: Learning to Generate Inversion-Resistant Model Explanations »
Hoyong Jeong · Suyoung Lee · Sung Ju Hwang · Sooel Son -
2022 : Distortion-Aware Network Pruning and Feature Reuse for Real-time Video Segmentation »
Hyunsu Rhee · Dongchan Min · Sunil Hwang · Bruno Andreis · Sung Ju Hwang -
2022 : Few-Shot Transferable Robust Representation Learning via Bilevel Attacks »
Minseon Kim · Hyeonjeong Ha · Sung Ju Hwang -
2023 Poster: Generalizable Lightweight Proxy for Robust NAS against Diverse Perturbations »
Hyeonjeong Ha · Minseon Kim · Sung Ju Hwang -
2023 Poster: Effective Targeted Attacks for Adversarial Self-Supervised Learning »
Minseon Kim · Hyeonjeong Ha · Sooel Son · Sung Ju Hwang -
2020 Poster: Bootstrapping neural processes »
Juho Lee · Yoonho Lee · Jungtaek Kim · Eunho Yang · Sung Ju Hwang · Yee Whye Teh -
2020 Poster: Distribution Aligning Refinery of Pseudo-label for Imbalanced Semi-supervised Learning »
Jaehyung Kim · Youngbum Hur · Sejun Park · Eunho Yang · Sung Ju Hwang · Jinwoo Shin -
2020 Poster: Learning to Extrapolate Knowledge: Transductive Few-shot Out-of-Graph Link Prediction »
Jinheon Baek · Dong Bok Lee · Sung Ju Hwang -
2020 Poster: Time-Reversal Symmetric ODE Network »
In Huh · Eunho Yang · Sung Ju Hwang · Jinwoo Shin -
2020 Poster: Neural Complexity Measures »
Yoonho Lee · Juho Lee · Sung Ju Hwang · Eunho Yang · Seungjin Choi -
2020 Poster: Adversarial Self-Supervised Contrastive Learning »
Minseon Kim · Jihoon Tack · Sung Ju Hwang -
2020 Poster: MetaPerturb: Transferable Regularizer for Heterogeneous Tasks and Architectures »
Jeong Un Ryu · JaeWoong Shin · Hae Beom Lee · Sung Ju Hwang -
2020 Spotlight: MetaPerturb: Transferable Regularizer for Heterogeneous Tasks and Architectures »
Jeong Un Ryu · JaeWoong Shin · Hae Beom Lee · Sung Ju Hwang -
2020 Poster: Few-shot Visual Reasoning with Meta-Analogical Contrastive Learning »
Youngsung Kim · Jinwoo Shin · Eunho Yang · Sung Ju Hwang -
2020 Poster: Attribution Preservation in Network Compression for Reliable Network Interpretation »
Geondo Park · June Yong Yang · Sung Ju Hwang · Eunho Yang -
2018 Poster: Uncertainty-Aware Attention for Reliable Interpretation and Prediction »
Jay Heo · Hae Beom Lee · Saehoon Kim · Juho Lee · Kwang Joon Kim · Eunho Yang · Sung Ju Hwang -
2018 Poster: Joint Active Feature Acquisition and Classification with Variable-Size Set Encoding »
Hajin Shim · Sung Ju Hwang · Eunho Yang -
2018 Poster: DropMax: Adaptive Variational Softmax »
Hae Beom Lee · Juho Lee · Saehoon Kim · Eunho Yang · Sung Ju Hwang