Timezone: »

 
Poster
Matching neural paths: transfer from recognition to correspondence search
Nikolay Savinov · Lubor Ladicky · Marc Pollefeys

Mon Dec 04 06:30 PM -- 10:30 PM (PST) @ Pacific Ballroom #9
in Posters Mon »

Many machine learning tasks require finding per-part correspondences between objects. In this work we focus on low-level correspondences --- a highly ambiguous matching problem. We propose to use a hierarchical semantic representation of the objects, coming from a convolutional neural network, to solve this ambiguity. Training it for low-level correspondence prediction directly might not be an option in some domains where the ground-truth correspondences are hard to obtain. We show how transfer from recognition can be used to avoid such training. Our idea is to mark parts as ``matching'' if their features are close to each other at all the levels of convolutional feature hierarchy (neural paths). Although the overall number of such paths is exponential in the number of layers, we propose a polynomial algorithm for aggregating all of them in a single backward pass. The empirical validation is done on the task of stereo correspondence and demonstrates that we achieve competitive results among the methods which do not use labeled target domain data.

Keywords: Deep Learning · Multitask and Transfer Learning

Author Information

Nikolay Savinov (ETH Zurich)
Lubor Ladicky (ETH Zurich)
Marc Pollefeys (ETH Zurich)

More from the Same Authors