Timezone: »

 
Poster
Depth Uncertainty in Neural Networks
Javier Antorán · James Allingham · José Miguel Hernández-Lobato

Thu Dec 10 09:00 AM -- 11:00 AM (PST) @ Poster Session 5 #1619
in Poster Session 6 »

Existing methods for estimating uncertainty in deep learning tend to require multiple forward passes, making them unsuitable for applications where computational resources are limited. To solve this, we perform probabilistic reasoning over the depth of neural networks. Different depths correspond to subnetworks which share weights and whose predictions are combined via marginalisation, yielding model uncertainty. By exploiting the sequential structure of feed-forward networks, we are able to both evaluate our training objective and make predictions with a single forward pass. We validate our approach on real-world regression and image classification tasks. Our approach provides uncertainty calibration, robustness to dataset shift, and accuracies competitive with more computationally expensive baselines.

Author Information

Javier Antorán (University of Cambridge)
James Allingham (University of Cambridge)
José Miguel Hernández-Lobato (University of Cambridge)

More from the Same Authors