Timezone: »
Neural radiance fields (NeRF) have brought tremendous progress to novel view synthesis. Though NeRF enables the rendering of subtle details in a scene by learning from a dense set of images, it also reconstructs the undesired reflections when we capture images through glass. As a commonly observed interference, the reflection would undermine the visibility of the desired transmitted scene behind glass by occluding the transmitted light rays. In this paper, we aim at addressing the problem of rendering novel transmitted views given a set of reflection-corrupted images. By introducing the transmission encoder and recurring edge constraints as guidance, our neural transmitted radiance fields can resist such reflection interference during rendering and reconstruct high-fidelity results even under sparse views. The proposed method achieves superior performance from the experiments on a newly collected dataset compared with state-of-the-art methods.
Author Information
Chengxuan Zhu (Peking University)
Renjie Wan (Hong Kong Baptist University)
Boxin Shi (Peking University)
Related Events (a corresponding poster, oral, or spotlight)
-
2022 Poster: Neural Transmitted Radiance Fields »
Wed. Nov 30th through Dec 1st Room Hall J #900
More from the Same Authors
-
2023 Poster: Slow and Weak Attractor Computation Embedded in Fast and Strong E-I Balanced Neural Dynamics »
Xiaohan Lin · Liyuan Li · Boxin Shi · Tiejun Huang · Yuanyuan Mi · Si Wu -
2023 Poster: L-CAD: Language-based Colorization with Any-level Descriptions »
zheng chang · Shuchen Weng · Peixuan Zhang · Yu Li · Si Li · Boxin Shi -
2023 Poster: LuminAIRe: Illumination-Aware Conditional Image Repainting for Lighting-Realistic Generation »
Jiajun Tang · Haofeng Zhong · Shuchen Weng · Boxin Shi -
2021 Poster: Learning to dehaze with polarization »
Chu Zhou · Minggui Teng · Yufei Han · Chao Xu · Boxin Shi -
2020 Poster: Domain Generalization for Medical Imaging Classification with Linear-Dependency Regularization »
Haoliang Li · Yufei Wang · Renjie Wan · Shiqi Wang · Tie-Qiang Li · Alex Kot -
2020 Poster: Group Contextual Encoding for 3D Point Clouds »
Xu Liu · Chengtao Li · Jian Wang · Jingbo Wang · Boxin Shi · Xiaodong He -
2020 Poster: UnModNet: Learning to Unwrap a Modulo Image for High Dynamic Range Imaging »
Chu Zhou · Hang Zhao · Jin Han · Chang Xu · Chao Xu · Tiejun Huang · Boxin Shi -
2020 Poster: GPS-Net: Graph-based Photometric Stereo Network »
Zhuokun Yao · Kun Li · Ying Fu · Haofeng Hu · Boxin Shi -
2019 Poster: Reflection Separation using a Pair of Unpolarized and Polarized Images »
Youwei Lyu · Zhaopeng Cui · Si Li · Marc Pollefeys · Boxin Shi -
2019 Spotlight: Reflection Separation using a Pair of Unpolarized and Polarized Images »
Youwei Lyu · Zhaopeng Cui · Si Li · Marc Pollefeys · Boxin Shi -
2019 Poster: Learning from Bad Data via Generation »
Tianyu Guo · Chang Xu · Boxin Shi · Chao Xu · Dacheng Tao