Timezone: »
Panchromatic (PAN) and multi-spectral (MS) image fusion, named Pan-sharpening, refers to super-resolve the low-resolution (LR) multi-spectral (MS) images in the spatial domain to generate the expected high-resolution (HR) MS images, conditioning on the corresponding high-resolution PAN images. In this paper, we present a simple yet effective alternating reverse filtering network for pan-sharpening. Inspired by the classical reverse filtering that reverses images to the status before filtering, we formulate pan-sharpening as an alternately iterative reverse filtering process, which fuses LR MS and HR MS in an interpretable manner. Different from existing model-driven methods that require well-designed priors and degradation assumptions, the reverse filtering process avoids the dependency on pre-defined exact priors. To guarantee the stability and convergence of the iterative process via contraction mapping on a metric space, we develop the learnable multi-scale Gaussian kernel module, instead of using specific filters. We demonstrate the theoretical feasibility of such formulations. Extensive experiments on diverse scenes to thoroughly verify the performance of our method, significantly outperforming the state of the arts.
Author Information
Keyu Yan (University of Science and Technology of China)
Man Zhou (Hefei Institutes of Physical Science, Chinese Academy of Sciences)
Jie Huang (University of Science and Technology of China)
Feng Zhao (University of Science and Technology of China)
Chengjun Xie (Hefei Institutes of Physical Science, Chinese Academy of Sciences)
Chongyi Li (City University of Hong Kong)
Danfeng Hong (Aerospace Information Research Institute, Chinese Academy of Sciences)
More from the Same Authors
-
2023 Poster: FouriDown: Factoring Down-Sampling into Shuffling and Superposing »
Qi Zhu · man zhou · Jie Huang · Naishan Zheng · Hongzhi Gao · Chongyi Li · Yuan Xu · Feng Zhao -
2023 Poster: Deep Fractional Fourier Transform »
Hu Yu · Jie Huang · Lingzhi LI · man zhou · Feng Zhao -
2023 Poster: Transition-constant Normalization for Image Enhancement »
Jie Huang · man zhou · Jinghao Zhang · Gang Yang · Mingde Yao · Chongyi Li · Zhiwei Xiong · Feng Zhao -
2022 Spotlight: Lightning Talks 2B-4 »
Feiyi Xiao · Amrutha Saseendran · Kwangho Kim · Keyu Yan · Changjian Shui · Guangxi Li · Shikun Li · Edward Kennedy · Man Zhou · Gezheng Xu · Ruilin Ye · Xiaobo Xia · Junjie Tang · Kathrin Skubch · Stefan Falkner · Hansong Zhang · Jose Zubizarreta · Huaying Fang · Xuanqiang Zhao · Jie Huang · Qi CHEN · Yibing Zhan · Jiaqi Li · Xin Wang · Ruibin Xi · Feng Zhao · Margret Keuper · Charles Ling · Shiming Ge · Chengjun Xie · Tongliang Liu · Tal Arbel · Chongyi Li · Danfeng Hong · Boyu Wang · Christian Gagné -
2022 Spotlight: Deep Fourier Up-Sampling »
man zhou · Hu Yu · Jie Huang · Feng Zhao · Jinwei Gu · Chen Change Loy · Deyu Meng · Chongyi Li -
2022 Spotlight: Panchromatic and Multispectral Image Fusion via Alternating Reverse Filtering Network »
Keyu Yan · Man Zhou · Jie Huang · Feng Zhao · Chengjun Xie · Chongyi Li · Danfeng Hong -
2022 Spotlight: Lightning Talks 2B-1 »
Yehui Tang · Jian Wang · Zheng Chen · man zhou · Peng Gao · Chenyang Si · SHANGKUN SUN · Yixing Xu · Weihao Yu · Xinghao Chen · Kai Han · Hu Yu · Yulun Zhang · Chenhui Gou · Teli Ma · Yuanqi Chen · Yunhe Wang · Hongsheng Li · Jinjin Gu · Jianyuan Guo · Qiman Wu · Pan Zhou · Yu Zhu · Jie Huang · Chang Xu · Yichen Zhou · Haocheng Feng · Guodong Guo · yongbing zhang · Ziyi Lin · Feng Zhao · Ge Li · Junyu Han · Jinwei Gu · Jifeng Dai · Chao Xu · Xinchao Wang · Linghe Kong · Shuicheng Yan · Yu Qiao · Chen Change Loy · Xin Yuan · Errui Ding · Yunhe Wang · Deyu Meng · Jingdong Wang · Chongyi Li -
2022 Poster: Deep Fourier Up-Sampling »
man zhou · Hu Yu · Jie Huang · Feng Zhao · Jinwei Gu · Chen Change Loy · Deyu Meng · Chongyi Li -
2022 Poster: Roadblocks for Temporarily Disabling Shortcuts and Learning New Knowledge »
Hongjing Niu · Hanting Li · Feng Zhao · Bin Li