Timezone: »
Machine Comprehension (MC) is one of the core problems in natural language processing, requiring both understanding of the natural language and knowledge about the world. Rapid progress has been made since the release of several benchmark datasets, and recently the state-of-the-art models even surpass human performance on the well-known SQuAD evaluation. In this paper, we transfer knowledge learned from machine comprehension to the sequence-to-sequence tasks to deepen the understanding of the text. We propose MacNet: a novel encoder-decoder supplementary architecture to the widely used attention-based sequence-to-sequence models. Experiments on neural machine translation (NMT) and abstractive text summarization show that our proposed framework can significantly improve the performance of the baseline models, and our method for the abstractive text summarization achieves the state-of-the-art results on the Gigaword dataset.
Author Information
Boyuan Pan (Zhejiang University)
Yazheng Yang (Zhejiang University)
Hao Li (Zhejiang University)
Zhou Zhao (Zhejiang University)
Yueting Zhuang (Zhejiang University)
Deng Cai (Zhejiang University)
Xiaofei He (Zhejiang University)
More from the Same Authors
-
2022 Poster: GenerSpeech: Towards Style Transfer for Generalizable Out-Of-Domain Text-to-Speech »
Rongjie Huang · Yi Ren · Jinglin Liu · Chenye Cui · Zhou Zhao -
2022 Poster: Towards Effective Multi-Modal Interchanges in Zero-Resource Sounding Object Localization »
Yang Zhao · Chen Zhang · Haifeng Huang · Haoyuan Li · Zhou Zhao -
2022 Poster: Dict-TTS: Learning to Pronounce with Prior Dictionary Knowledge for Text-to-Speech »
Ziyue Jiang · Zhe Su · Zhou Zhao · Qian Yang · Yi Ren · Jinglin Liu · 振辉 叶 -
2022 Poster: M4Singer: A Multi-Style, Multi-Singer and Musical Score Provided Mandarin Singing Corpus »
Lichao Zhang · Ruiqi Li · Shoutong Wang · Liqun Deng · Jinglin Liu · Yi Ren · Jinzheng He · Rongjie Huang · Jieming Zhu · Xiao Chen · Zhou Zhao -
2022 Spotlight: Fine-Grained Semantically Aligned Vision-Language Pre-Training »
Juncheng Li · XIN HE · Longhui Wei · Long Qian · Linchao Zhu · Lingxi Xie · Yueting Zhuang · Qi Tian · Siliang Tang -
2022 Spotlight: Lightning Talks 4B-4 »
Ziyue Jiang · Zeeshan Khan · Yuxiang Yang · Chenze Shao · Yichong Leng · Zehao Yu · Wenguan Wang · Xian Liu · Zehua Chen · Yang Feng · Qianyi Wu · James Liang · C.V. Jawahar · Junjie Yang · Zhe Su · Songyou Peng · Yufei Xu · Junliang Guo · Michael Niemeyer · Hang Zhou · Zhou Zhao · Makarand Tapaswi · Dongfang Liu · Qian Yang · Torsten Sattler · Yuanqi Du · Haohe Liu · Jing Zhang · Andreas Geiger · Yi Ren · Long Lan · Jiawei Chen · Wayne Wu · Dahua Lin · Dacheng Tao · Xu Tan · Jinglin Liu · Ziwei Liu · 振辉 叶 · Danilo Mandic · Lei He · Xiangyang Li · Tao Qin · sheng zhao · Tie-Yan Liu -
2022 Spotlight: Dict-TTS: Learning to Pronounce with Prior Dictionary Knowledge for Text-to-Speech »
Ziyue Jiang · Zhe Su · Zhou Zhao · Qian Yang · Yi Ren · Jinglin Liu · 振辉 叶 -
2022 Spotlight: GenerSpeech: Towards Style Transfer for Generalizable Out-Of-Domain Text-to-Speech »
Rongjie Huang · Yi Ren · Jinglin Liu · Chenye Cui · Zhou Zhao -
2022 Spotlight: M4Singer: A Multi-Style, Multi-Singer and Musical Score Provided Mandarin Singing Corpus »
Lichao Zhang · Ruiqi Li · Shoutong Wang · Liqun Deng · Jinglin Liu · Yi Ren · Jinzheng He · Rongjie Huang · Jieming Zhu · Xiao Chen · Zhou Zhao -
2022 Poster: Unsupervised Representation Learning from Pre-trained Diffusion Probabilistic Models »
Zijian Zhang · Zhou Zhao · Zhijie Lin -
2022 Poster: Fine-Grained Semantically Aligned Vision-Language Pre-Training »
Juncheng Li · XIN HE · Longhui Wei · Long Qian · Linchao Zhu · Lingxi Xie · Yueting Zhuang · Qi Tian · Siliang Tang -
2021 Poster: Learning to Generate Visual Questions with Noisy Supervision »
Shen Kai · Lingfei Wu · Siliang Tang · Yueting Zhuang · zhen he · Zhuoye Ding · Yun Xiao · Bo Long -
2021 Poster: PortaSpeech: Portable and High-Quality Generative Text-to-Speech »
Yi Ren · Jinglin Liu · Zhou Zhao -
2021 Poster: Generalizable Multi-linear Attention Network »
Tao Jin · Zhou Zhao -
2021 Poster: Do Wider Neural Networks Really Help Adversarial Robustness? »
Boxi Wu · Jinghui Chen · Deng Cai · Xiaofei He · Quanquan Gu -
2020 Poster: Pixel-Level Cycle Association: A New Perspective for Domain Adaptive Semantic Segmentation »
Guoliang Kang · Yunchao Wei · Yi Yang · Yueting Zhuang · Alexander Hauptmann -
2020 Poster: Counterfactual Contrastive Learning for Weakly-Supervised Vision-Language Grounding »
Zhu Zhang · Zhou Zhao · Zhijie Lin · jieming zhu · Xiuqiang He -
2020 Oral: Pixel-Level Cycle Association: A New Perspective for Domain Adaptive Semantic Segmentation »
Guoliang Kang · Yunchao Wei · Yi Yang · Yueting Zhuang · Alexander Hauptmann -
2019 Poster: FastSpeech: Fast, Robust and Controllable Text to Speech »
Yi Ren · Yangjun Ruan · Xu Tan · Tao Qin · Sheng Zhao · Zhou Zhao · Tie-Yan Liu -
2012 Poster: Multi-task Vector Field Learning »
Binbin Lin · Sen Yang · Chiyuan Zhang · Jieping Ye · Xiaofei He -
2011 Poster: Semi-supervised Regression via Parallel Field Regularization »
Binbin Lin · Chiyuan Zhang · Xiaofei He