Timezone: »
3D instance segmentation is a challenging task due to the complex local geometric structures of objects in point clouds. In this paper, we propose a learning-based superpoint graph cut method that explicitly learns the local geometric structures of the point cloud for 3D instance segmentation. Specifically, we first oversegment the raw point clouds into superpoints and construct the superpoint graph. Then, we propose an edge score prediction network to predict the edge scores of the superpoint graph, where the similarity vectors of two adjacent nodes learned through cross-graph attention in the coordinate and feature spaces are used for regressing edge scores. By forcing two adjacent nodes of the same instance to be close to the instance center in the coordinate and feature spaces, we formulate a geometry-aware edge loss to train the edge score prediction network. Finally, we develop a superpoint graph cut network that employs the learned edge scores and the predicted semantic classes of nodes to generate instances, where bilateral graph attention is proposed to extract discriminative features on both the coordinate and feature spaces for predicting semantic labels and scores of instances. Extensive experiments on two challenging datasets, ScanNet v2 and S3DIS, show that our method achieves new state-of-the-art performance on 3D instance segmentation.
Author Information
Le Hui (Nanjing University of Science and Technology)
Linghua Tang (Nanjing University of Science and Technology)
Yaqi Shen (Nanjing University of Science and Technology)
Jin Xie (Department of Computer Science, Nanjing University of Science and Technology)
Jian Yang (Nanjing University of Science and Technology)
Related Events (a corresponding poster, oral, or spotlight)
-
2022 Poster: Learning Superpoint Graph Cut for 3D Instance Segmentation »
Dates n/a. Room
More from the Same Authors
-
2021 Spotlight: A$^2$-Net: Learning Attribute-Aware Hash Codes for Large-Scale Fine-Grained Image Retrieval »
Xiu-Shen Wei · Yang Shen · Xuhao Sun · Han-Jia Ye · Jian Yang -
2022 Spotlight: Lightning Talks 6B-3 »
Lingfeng Yang · Yao Lai · Zizheng Pan · Zhenyu Wang · Weicong Liang · Chuanyang Zheng · Jian-Wei Zhang · Peng Jin · Jing Liu · Xiuying Wei · Yao Mu · Xiang Li · YUHUI YUAN · Zizheng Pan · Yifan Sun · Yunchen Zhang · Jianfei Cai · Hao Luo · zheyang li · Jinfa Huang · Haoyu He · Yi Yang · Ping Luo · Fenglin Liu · Henghui Ding · Borui Zhao · Xiangguo Zhang · Kai Zhang · Pichao WANG · Bohan Zhuang · Wei Chen · Ruihao Gong · Zhi Yang · Xian Wu · Feng Ding · Jianfei Cai · Xiao Luo · Renjie Song · Weihong Lin · Jian Yang · Wenming Tan · Bohan Zhuang · Shanghang Zhang · Shen Ge · Fan Wang · Qi Zhang · Guoli Song · Jun Xiao · Hao Li · Ding Jia · David Clifton · Ye Ren · Fengwei Yu · Zheng Zhang · Jie Chen · Shiliang Pu · Xianglong Liu · Chao Zhang · Han Hu -
2022 Spotlight: RecursiveMix: Mixed Learning with History »
Lingfeng Yang · Xiang Li · Borui Zhao · Renjie Song · Jian Yang -
2022 Poster: RecursiveMix: Mixed Learning with History »
Lingfeng Yang · Xiang Li · Borui Zhao · Renjie Song · Jian Yang -
2022 Poster: Learning Contrastive Embedding in Low-Dimensional Space »
Shuo Chen · Chen Gong · Jun Li · Jian Yang · Gang Niu · Masashi Sugiyama -
2021 Poster: 3D Siamese Voxel-to-BEV Tracker for Sparse Point Clouds »
Le Hui · Lingpeng Wang · Mingmei Cheng · Jin Xie · Jian Yang -
2021 Poster: A$^2$-Net: Learning Attribute-Aware Hash Codes for Large-Scale Fine-Grained Image Retrieval »
Xiu-Shen Wei · Yang Shen · Xuhao Sun · Han-Jia Ye · Jian Yang -
2021 Poster: Learning to Adapt via Latent Domains for Adaptive Semantic Segmentation »
Yunan Liu · Shanshan Zhang · Yang Li · Jian Yang -
2020 Poster: Generalized Focal Loss: Learning Qualified and Distributed Bounding Boxes for Dense Object Detection »
Xiang Li · Wenhai Wang · Lijun Wu · Shuo Chen · Xiaolin Hu · Jun Li · Jinhui Tang · Jian Yang -
2019 Poster: Curvilinear Distance Metric Learning »
Shuo Chen · Lei Luo · Jian Yang · Chen Gong · Jun Li · Heng Huang