Timezone: »

 
Poster
Prototypical VoteNet for Few-Shot 3D Point Cloud Object Detection
Shizhen Zhao · Xiaojuan Qi

Thu Dec 01 02:00 PM -- 04:00 PM (PST) @ Hall J #142
in Poster Session 6 »

Most existing 3D point cloud object detection approaches heavily rely on large amounts of labeled training data. However, the labeling process is costly and time-consuming. This paper considers few-shot 3D point cloud object detection, where only a few annotated samples of novel classes are needed with abundant samples of base classes. To this end, we propose Prototypical VoteNet to recognize and localize novel instances, which incorporates two new modules: Prototypical Vote Module (PVM) and Prototypical Head Module (PHM). Specifically, as the 3D basic geometric structures can be shared among categories, PVM is designed to leverage class-agnostic geometric prototypes, which are learned from base classes, to refine local features of novel categories. Then PHM is proposed to utilize class prototypes to enhance the global feature of each object, facilitating subsequent object localization and classification, which is trained by the episodic training strategy. To evaluate the model in this new setting, we contribute two new benchmark datasets, FS-ScanNet and FS-SUNRGBD. We conduct extensive experiments to demonstrate the effectiveness of Prototypical VoteNet, and our proposed method shows significant and consistent improvements compared to baselines on two benchmark datasets.

Keywords: Few-Shot Learning · 3D Point Cloud Object Detection · Geometric Prototype · Class-Specific Prototype
[ Paper]  [ Poster]  [ OpenReview] 

Author Information

Shizhen Zhao (The University of Hong Kong,)
Shizhen Zhao

ShiZhen Zhao is a first year PhD student at the University of Hong Kong. He received his undergraduate degree from Wuhan University of Technology and his master degree from Huazhong University of Science and Technology. His current research interests focus on few-shot object detection.

Xiaojuan Qi (The University of Hong Kong)

More from the Same Authors