Timezone: »
Current methods for training convolutional neural networks depend on large amounts of labeled samples for supervised training. In this paper we present an approach for training a convolutional neural network using only unlabeled data. We train the network to discriminate between a set of surrogate classes. Each surrogate class is formed by applying a variety of transformations to a randomly sampled 'seed' image patch. We find that this simple feature learning algorithm is surprisingly successful when applied to visual object recognition. The feature representation learned by our algorithm achieves classification results matching or outperforming the current state-of-the-art for unsupervised learning on several popular datasets (STL-10, CIFAR-10, Caltech-101).
Author Information
Alexey Dosovitskiy (University of Freiburg)
Jost Tobias Springenberg (University of Freiburg)
Martin Riedmiller (University of Freiburg)
Thomas Brox (University of Freiburg)
More from the Same Authors
-
2022 : Towards Discovering Neural Architectures from Scratch »
Simon Schrodi · Danny Stoll · Robin Ru · Rhea Sukthanker · Thomas Brox · Frank Hutter -
2022 Poster: Assaying Out-Of-Distribution Generalization in Transfer Learning »
Florian Wenzel · Andrea Dittadi · Peter Gehler · Carl-Johann Simon-Gabriel · Max Horn · Dominik Zietlow · David Kernert · Chris Russell · Thomas Brox · Bernt Schiele · Bernhard Schölkopf · Francesco Locatello -
2020 Poster: COOT: Cooperative Hierarchical Transformer for Video-Text Representation Learning »
Simon Ging · Mohammadreza Zolfaghari · Hamed Pirsiavash · Thomas Brox -
2019 Poster: DeepUSPS: Deep Robust Unsupervised Saliency Prediction via Self-supervision »
Tam Nguyen · Maximilian Dax · Chaithanya Kumar Mummadi · Nhung Ngo · Thi Hoai Phuong Nguyen · Zhongyu Lou · Thomas Brox -
2016 : Learning 3D representations, disparity estimation, and structure from motion »
Thomas Brox -
2016 Poster: Bayesian Optimization with Robust Bayesian Neural Networks »
Jost Tobias Springenberg · Aaron Klein · Stefan Falkner · Frank Hutter -
2016 Poster: Protein contact prediction from amino acid co-evolution using convolutional networks for graph-valued images »
Vladimir Golkov · Marcin Skwark · Antonij Golkov · Alexey Dosovitskiy · Thomas Brox · Jens Meiler · Daniel Cremers -
2016 Oral: Bayesian Optimization with Robust Bayesian Neural Networks »
Jost Tobias Springenberg · Aaron Klein · Stefan Falkner · Frank Hutter -
2016 Oral: Protein contact prediction from amino acid co-evolution using convolutional networks for graph-valued images »
Vladimir Golkov · Marcin Skwark · Antonij Golkov · Alexey Dosovitskiy · Thomas Brox · Jens Meiler · Daniel Cremers -
2016 Poster: Generating Images with Perceptual Similarity Metrics based on Deep Networks »
Alexey Dosovitskiy · Thomas Brox -
2016 Poster: Synthesizing the preferred inputs for neurons in neural networks via deep generator networks »
Anh Nguyen · Alexey Dosovitskiy · Jason Yosinski · Thomas Brox · Jeff Clune -
2015 Poster: Embed to Control: A Locally Linear Latent Dynamics Model for Control from Raw Images »
Manuel Watter · Jost Springenberg · Joschka Boedecker · Martin Riedmiller -
2015 Poster: Efficient and Robust Automated Machine Learning »
Matthias Feurer · Aaron Klein · Katharina Eggensperger · Jost Springenberg · Manuel Blum · Frank Hutter