Timezone: »

 
Poster
A Fourier Perspective on Model Robustness in Computer Vision
Dong Yin · Raphael Gontijo Lopes · Jon Shlens · Ekin Dogus Cubuk · Justin Gilmer

Thu Dec 12 10:45 AM -- 12:45 PM (PST) @ East Exhibition Hall B + C #152
in Deep Learning -- Efficient Training Methods »

Achieving robustness to distributional shift is a longstanding and challenging goal of computer vision. Data augmentation is a commonly used approach for improving robustness, however robustness gains are typically not uniform across corruption types. Indeed increasing performance in the presence of random noise is often met with reduced performance on other corruptions such as contrast change. Understanding when and why these sorts of trade-offs occur is a crucial step towards mitigating them. Towards this end, we investigate recently observed trade-offs caused by Gaussian data augmentation and adversarial training. We find that both methods improve robustness to corruptions that are concentrated in the high frequency domain while reducing robustness to corruptions that are concentrated in the low frequency domain. This suggests that one way to mitigate these trade-offs via data augmentation is to use a more diverse set of augmentations. Towards this end we observe that AutoAugment, a recently proposed data augmentation policy optimized for clean accuracy, achieves state-of-the-art robustness on the CIFAR-10-C benchmark.

Keywords: Applications -> Computer Vision · Algorithms -> Adversarial Learning

Author Information

Dong Yin (UC Berkeley)
Raphael Gontijo Lopes (Google Brain)
Jon Shlens (Google Research)
Dogus Cubuk (Google Brain)
Justin Gilmer (Google Brain)

More from the Same Authors