Timezone: »

 
Poster
You Never Stop Dancing: Non-freezing Dance Generation via Bank-constrained Manifold Projection
Jiangxin Sun · Chunyu Wang · Huang Hu · Hanjiang Lai · Zhi Jin · Jian-Fang Hu

@

One of the most overlooked challenges in dance generation is that the auto-regressive frameworks are prone to freezing motions due to noise accumulation. In this paper, we present two modules that can be plugged into the existing models to enable them to generate non-freezing and high fidelity dances. Since the high-dimensional motion data are easily swamped by noise, we propose to learn a low-dimensional manifold representation by an auto-encoder with a bank of latent codes, which can be used to reduce the noise in the predicted motions, thus preventing from freezing. We further extend the bank to provide explicit priors about the future motions to disambiguate motion prediction, which helps the predictors to generate motions with larger magnitude and higher fidelity than possible before. Extensive experiments on AIST++, a public large-scale 3D dance motion benchmark, demonstrate that our method notably outperforms the baselines in terms of quality, diversity and time length.

Keywords: 3D dance generation · music conditioned human motion prediction
[ Paper]  [ Poster]  [ OpenReview] 

Author Information

Jiangxin Sun (Sun Yat-sen University)
Chunyu Wang (Microsoft)
Huang Hu (Microsoft)
Hanjiang Lai (Sun Yat-Sen university)
Zhi Jin (SUN YAT-SEN UNIVERSITY)
Jian-Fang Hu (SUN YAT-SEN UNIVERSITY)

More from the Same Authors