Timezone: »
3D human pose and shape estimation (a.k.a. ``human mesh recovery'') has achieved substantial progress. Researchers mainly focus on the development of novel algorithms, while less attention has been paid to other critical factors involved. This could lead to less optimal baselines, hindering the fair and faithful evaluations of newly designed methodologies. To address this problem, this work presents the \textit{first} comprehensive benchmarking study from three under-explored perspectives beyond algorithms. \emph{1) Datasets.} An analysis on 31 datasets reveals the distinct impacts of data samples: datasets featuring critical attributes (\emph{i.e.} diverse poses, shapes, camera characteristics, backbone features) are more effective. Strategical selection and combination of high-quality datasets can yield a significant boost to the model performance. \emph{2) Backbones.} Experiments with 10 backbones, ranging from CNNs to transformers, show the knowledge learnt from a proximity task is readily transferable to human mesh recovery. \emph{3) Training strategies.} Proper augmentation techniques and loss designs are crucial. With the above findings, we achieve a PA-MPJPE of 47.3 (mm) on the 3DPW test set with a relatively simple model. More importantly, we provide strong baselines for fair comparisons of algorithms, and recommendations for building effective training configurations in the future. Codebase is available at \url{https://github.com/smplbody/hmr-benchmarks}.
Author Information
Hui En Pang (Nanyang Technological University)
Zhongang Cai (SenseTime)
Lei Yang (The Chinese University of Hong Kong)
Tianwei Zhang (Nanyang Technological University)
Ziwei Liu (Nanyang Technological University)
Related Events (a corresponding poster, oral, or spotlight)
-
2022 Poster: Benchmarking and Analyzing 3D Human Pose and Shape Estimation Beyond Algorithms »
Dates n/a. Room
More from the Same Authors
-
2021 : Semi-Supervised Domain Generalization with Stochastic StyleMatch »
Kaiyang Zhou · Chen Change Loy · Ziwei Liu -
2022 Poster: Audio-Driven Co-Speech Gesture Video Generation »
Xian Liu · Qianyi Wu · Hang Zhou · Yuanqi Du · Wayne Wu · Dahua Lin · Ziwei Liu -
2022 : Sparse Mixture-of-Experts are Domain Generalizable Learners »
Bo Li · Yifei Shen · Jingkang Yang · Yezhen Wang · Jiawei Ren · Tong Che · Jun Zhang · Ziwei Liu -
2023 : SAD: Segment Any RGBD »
Jun CEN · Yizheng Wu · Kewei Wang · Xingyi Li · Jingkang Yang · Yixuan Pei · Lingdong Kong · Ziwei Liu · Qifeng Chen -
2023 : Knowledge Augmented Instruction Tuning for Zero-shot Animal Species Recognition »
Zalan Fabian · Zhongqi Miao · Chunyuan Li · Yuanhan Zhang · Ziwei Liu · Andres Hernandez · Pablo Arbelaez · Andrés Link · Andrés Montes-Rojas · Rafael Escucha · Laura Siabatto · Rahul Dodhia · Juan Lavista Ferres -
2023 : OpenOOD v1.5: Enhanced Benchmark for Out-of-Distribution Detection »
Jingyang Zhang · Jingkang Yang · Pengyun Wang · Haoqi Wang · Yueqian Lin · Haoran Zhang · Yiyou Sun · Xuefeng Du · Kaiyang Zhou · Wayne Zhang · Yixuan Li · Ziwei Liu · Yiran Chen · Hai Li -
2023 Poster: What Makes Good Examples for Visual In-Context Learning? »
Yuanhan Zhang · Kaiyang Zhou · Ziwei Liu -
2023 Poster: Segment Any Point Cloud Sequences by Distilling Vision Foundation Models »
Youquan Liu · Lingdong Kong · Jun CEN · Runnan Chen · Wenwei Zhang · Liang Pan · Kai Chen · Ziwei Liu -
2023 Poster: InsActor: Instruction-driven Physics-based Characters »
Jiawei Ren · Mingyuan Zhang · Cunjun Yu · Xiao Ma · Liang Pan · Ziwei Liu -
2023 Poster: Towards Robust and Expressive Whole-body Human Pose and Shape Estimation »
Hui En Pang · Zhongang Cai · Lei Yang · Qingyi Tao · Zhonghua Wu · Tianwei Zhang · Ziwei Liu -
2023 Poster: FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editing »
Mingyuan Zhang · Huirong Li · Zhongang Cai · Jiawei Ren · Lei Yang · Ziwei Liu -
2023 Poster: 4D Panoptic Scene Graph Generation »
Jingkang Yang · Jun CEN · WENXUAN PENG · Shuai Liu · Fangzhou Hong · Xiangtai Li · Kaiyang Zhou · Qifeng Chen · Ziwei Liu -
2023 Poster: PrimDiffusion: Volumetric Primitives Diffusion for 3D Human Generation »
Zhaoxi Chen · Fangzhou Hong · Haiyi Mei · Guangcong Wang · Lei Yang · Ziwei Liu -
2023 Poster: Large Language Models are Visual Reasoning Coordinators »
Liangyu Chen · Bo Li · Sheng Shen · Jingkang Yang · Chunyuan Li · Kurt Keutzer · Trevor Darrell · Ziwei Liu -
2023 Poster: SMPLer-X: Scaling Up Expressive Human Pose and Shape Estimation »
Zhongang Cai · Wanqi Yin · Ailing Zeng · CHEN WEI · Qingping SUN · Wang Yanjun · Hui En Pang · Haiyi Mei · Mingyuan Zhang · Lei Zhang · Chen Change Loy · Lei Yang · Ziwei Liu -
2023 Poster: RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatars »
Dongwei Pan · Long Zhuo · Jingtan Piao · Huiwen Luo · Wei Cheng · Yuxin WANG · Siming Fan · Shengqi Liu · Lei Yang · Bo Dai · Ziwei Liu · Chen Change Loy · Chen Qian · Wayne Wu · Dahua Lin · Kwan-Yee Lin -
2022 Spotlight: Lightning Talks 4B-4 »
Ziyue Jiang · Zeeshan Khan · Yuxiang Yang · Chenze Shao · Yichong Leng · Zehao Yu · Wenguan Wang · Xian Liu · Zehua Chen · Yang Feng · Qianyi Wu · James Liang · C.V. Jawahar · Junjie Yang · Zhe Su · Songyou Peng · Yufei Xu · Junliang Guo · Michael Niemeyer · Hang Zhou · Zhou Zhao · Makarand Tapaswi · Dongfang Liu · Qian Yang · Torsten Sattler · Yuanqi Du · Haohe Liu · Jing Zhang · Andreas Geiger · Yi Ren · Long Lan · Jiawei Chen · Wayne Wu · Dahua Lin · Dacheng Tao · Xu Tan · Jinglin Liu · Ziwei Liu · 振辉 叶 · Danilo Mandic · Lei He · Xiangyang Li · Tao Qin · sheng zhao · Tie-Yan Liu -
2022 Spotlight: Audio-Driven Co-Speech Gesture Video Generation »
Xian Liu · Qianyi Wu · Hang Zhou · Yuanqi Du · Wayne Wu · Dahua Lin · Ziwei Liu -
2022 Poster: Iron: Private Inference on Transformers »
Meng Hao · Hongwei Li · Hanxiao Chen · Pengzhi Xing · Guowen Xu · Tianwei Zhang -
2022 Poster: AnimeRun: 2D Animation Visual Correspondence from Open Source 3D Movies »
Li Siyao · Yuhang Li · Bo Li · Chao Dong · Ziwei Liu · Chen Change Loy -
2022 Poster: OpenOOD: Benchmarking Generalized Out-of-Distribution Detection »
Jingkang Yang · Pengyun Wang · Dejian Zou · Zitang Zhou · Kunyuan Ding · WENXUAN PENG · Haoqi Wang · Guangyao Chen · Bo Li · Yiyou Sun · Xuefeng Du · Kaiyang Zhou · Wayne Zhang · Dan Hendrycks · Yixuan Li · Ziwei Liu -
2021 Poster: Balanced Chamfer Distance as a Comprehensive Metric for Point Cloud Completion »
Tong Wu · Liang Pan · Junzhe Zhang · Tai WANG · Ziwei Liu · Dahua Lin -
2021 Poster: Garment4D: Garment Reconstruction from Point Cloud Sequences »
Fangzhou Hong · Liang Pan · Zhongang Cai · Ziwei Liu -
2021 Poster: Few-Shot Object Detection via Association and DIscrimination »
Yuhang Cao · Jiaqi Wang · Ying Jin · Tong Wu · Kai Chen · Ziwei Liu · Dahua Lin -
2021 Poster: Unsupervised Object-Level Representation Learning from Scene Images »
Jiahao Xie · Xiaohang Zhan · Ziwei Liu · Yew Soon Ong · Chen Change Loy