Skip to yearly menu bar Skip to main content


Scenario Diffusion: Controllable Driving Scenario Generation With Diffusion

Ethan Pronovost · Meghana Reddy Ganesina · Noureldin Hendy · Zeyu Wang · Andres Morales · Kai Wang · Nick Roy

Great Hall & Hall B1+B2 (level 1) #530
[ ]
[ Paper [ Poster [ OpenReview
Tue 12 Dec 3:15 p.m. PST — 5:15 p.m. PST


Automated creation of synthetic traffic scenarios is a key part of scaling the safety validation of autonomous vehicles (AVs). In this paper, we propose Scenario Diffusion, a novel diffusion-based architecture for generating traffic scenarios that enables controllable scenario generation. We combine latent diffusion, object detection and trajectory regression to generate distributions of synthetic agent poses, orientations and trajectories simultaneously. This distribution is conditioned on the map and sets of tokens describing the desired scenario to provide additional control over the generated scenario. We show that our approach has sufficient expressive capacity to model diverse traffic patterns and generalizes to different geographical regions.

Chat is not available.