Real-Time and Accurate Self-Supervised Monocular Depth Estimation on Mobile Device
Hong Cai ⋅ Yinhao Zhu ⋅ Janarbek Matai ⋅ Fatih Porikli ⋅ Fei Yin ⋅ Tushar Singhal ⋅ Bharath Ramaswamy ⋅ Frank Mayer ⋅ Chirag Patel ⋅ Parham Noorzad ⋅ Andrii Skliar ⋅ Tijmen Blankevoort ⋅ Joseph Soriaga ⋅ Ron Tindall ⋅ Pat Lawlor
2021 Live Demo
in
Demonstration: Demonstrations 3
in
Demonstration: Demonstrations 3
Abstract
This demonstration showcases our novel innovations on self-supervised monocular depth estimation. First, we enhance self-supervised monocular depth estimation with semantic information during training. This reduces the error by 12% and achieves state-of-the-art performance. Second, we enhance the backbone architecture using a scalable method for neural architecture search which optimizes directly for inference latency on a target device. This enables operation at > 30 FPS. We demonstrate these techniques on a smartphone powered by a Snapdragon® Mobile Platform.
Chat is not available.
Successful Page Load