Timezone: »

 
Poster
Deep Generative Video Compression
Salvator Lombardo · JUN HAN · Christopher Schroers · Stephan Mandt

Wed Dec 11 10:45 AM -- 12:45 PM (PST) @ East Exhibition Hall B + C #108
in Deep Learning -- Generative Models »

The usage of deep generative models for image compression has led to impressive performance gains over classical codecs while neural video compression is still in its infancy. Here, we propose an end-to-end, deep generative modeling approach to compress temporal sequences with a focus on video. Our approach builds upon variational autoencoder (VAE) models for sequential data and combines them with recent work on neural image compression. The approach jointly learns to transform the original sequence into a lower-dimensional representation as well as to discretize and entropy code this representation according to predictions of the sequential VAE. Rate-distortion evaluations on small videos from public data sets with varying complexity and diversity show that our model yields competitive results when trained on generic video content. Extreme compression performance is achieved when training the model on specialized content.

Keywords: Applications · Generative Models; Probabilistic Methods · Applications -> Computer Vision; Deep Learning -> Deep Autoencoders; Deep Learning
[ Paper]  [ Poster] 

Author Information

Salvator Lombardo (Disney Research)
JUN HAN (Dartmouth College)

I am a Ph.D. student in Computer Science at Dartmouth College.

Christopher Schroers (Disney Research|Studios)
Stephan Mandt (University of California, Irvine)
Stephan Mandt

Stephan Mandt is an Associate Professor of Computer Science and Statistics at the University of California, Irvine. From 2016 until 2018, he was a Senior Researcher and Head of the statistical machine learning group at Disney Research in Pittsburgh and Los Angeles. He held previous postdoctoral positions at Columbia University and Princeton University. Stephan holds a Ph.D. in Theoretical Physics from the University of Cologne, where he received the German National Merit Scholarship. He is furthermore a recipient of the NSF CAREER Award, the UCI ICS Mid-Career Excellence in Research Award, the German Research Foundation's Mercator Fellowship, a Kavli Fellow of the U.S. National Academy of Sciences, a member of the ELLIS Society, and a former visiting researcher at Google Brain. Stephan regularly serves as an Area Chair, Action Editor, or Editorial Board member for NeurIPS, ICML, AAAI, ICLR, TMLR, and JMLR. His research is currently supported by NSF, DARPA, DOE, Disney, Intel, and Qualcomm.

More from the Same Authors