Skip to yearly menu bar Skip to main content


Poster
in
Workshop: NeurIPS 2023 Workshop on Machine Learning for Creativity and Design

Real-time Animation Generation and Control on Rigged Models via Large Language Models

Han Huang · Fernanda De La Torre · Cathy Mengying Fang · Andrzej Banburski · Judith Amores · Jaron Lanier

[ ]
[ Poster
Sat 16 Dec 1:30 p.m. PST — 2:30 p.m. PST
 
presentation: NeurIPS 2023 Workshop on Machine Learning for Creativity and Design
Sat 16 Dec 6:15 a.m. PST — 2:40 p.m. PST

Abstract:

We introduce a novel method for real-time animation control and generation onrigged models using natural language input. First, we embed a large languagemodel (LLM) in Unity to output structured texts that can be parsed into diverseand realistic animations. Second, we illustrate LLM’s potential to enable flexiblestate transition between existing animations. We showcase the robustness of ourapproach through qualitative results on various rigged models and motions.

Chat is not available.