Demonstration
One-on-one fitness training with an AI avatar
Roland Memisevic · Guillaume Berger · Tippi Puar · David Greenberg
East Exhibition Hall B, C #812
[
Abstract
]
Abstract:
In this demo, we will showcase “Millie” our live digital fitness trainer. She is an on-screen avatar that interacts in real-time to observe and grade the user’s movements for speed, accuracy and form. Millie is powered by an audio-visual neural network that processes the video and voice input using 3D convolutions to power the avatar’s responses. The neural network is trained on several million sample videos showing crowd-workers performing actions that they recorded using consumer grade RGB cameras and microphones. This allows the digital fitness trainer to run on a wide range of hardware devices, such as iPhone, iPad and in the cloud.
Live content is unavailable. Log in and register to view live content