Timezone: »

 
Spotlight
Reflection Separation using a Pair of Unpolarized and Polarized Images
Youwei Lyu · Zhaopeng Cui · Si Li · Marc Pollefeys · Boxin Shi

Thu Dec 12 04:55 PM -- 05:00 PM (PST) @ West Ballroom C
in Track 4 Session 6 »

When we take photos through glass windows or doors, the transmitted background scene is often blended with undesirable reflection. Separating two layers apart to enhance the image quality is of vital importance for both human and machine perception. In this paper, we propose to exploit physical constraints from a pair of unpolarized and polarized images to separate reflection and transmission layers. Due to the simplified capturing setup, the system becomes more underdetermined compared with existing polarization based solutions that take three or more images as input. We propose to solve semireflector orientation estimation first to make the physical image formation well-posed and then learn to reliably separate two layers using a refinement network with gradient loss. Quantitative and qualitative experimental results show our approach performs favorably over existing polarization and single image based solutions.

[ Paper]  [ Poster]  [ Slides] 

Author Information

Youwei Lyu (Beijing University of Posts and Telecommunications)
Zhaopeng Cui (ETH Zurich)
Si Li (Beijing University of Posts and Telecommunications)
Marc Pollefeys (ETH Zurich)
Boxin Shi (Peking University)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors