`

Timezone: »

 
Poster
Deep Automodulators
Ari Heljakka · Yuxin Hou · Juho Kannala · Arno Solin

Tue Dec 08 09:00 PM -- 11:00 PM (PST) @ Poster Session 2 #694

We introduce a new category of generative autoencoders called automodulators. These networks can faithfully reproduce individual real-world input images like regular autoencoders, but also generate a fused sample from an arbitrary combination of several such images, allowing instantaneous "style-mixing" and other new applications. An automodulator decouples the data flow of decoder operations from statistical properties thereof and uses the latent vector to modulate the former by the latter, with a principled approach for mutual disentanglement of decoder layers. Prior work has explored similar decoder architecture with GANs, but their focus has been on random sampling. A corresponding autoencoder could operate on real input images. For the first time, we show how to train such a general-purpose model with sharp outputs in high resolution, using novel training techniques, demonstrated on four image data sets. Besides style-mixing, we show state-of-the-art results in autoencoder comparison, and visual image quality nearly indistinguishable from state-of-the-art GANs. We expect the automodulator variants to become a useful building block for image applications and other data domains.

Author Information

Ari Heljakka (Aalto University)
Yuxin Hou (Aalto University)
Juho Kannala (Aalto University)
Arno Solin (Aalto University)

More from the Same Authors

  • 2021 : Sparse Gaussian Processes for Stochastic Differential Equations »
    Prakhar Verma · Vincent ADAM · Arno Solin
  • 2021 Poster: Dual Parameterization of Sparse Variational Gaussian Processes »
    Vincent ADAM · Paul Chang · Emtiyaz Khan · Arno Solin
  • 2021 Poster: Periodic Activation Functions Induce Stationarity »
    Lassi Meronen · Martin Trapp · Arno Solin
  • 2021 Poster: Spatio-Temporal Variational Gaussian Processes »
    Oliver Hamelijnck · William Wilkinson · Niki Loppi · Arno Solin · Theodoros Damoulas
  • 2021 Poster: Scalable Inference in SDEs by Direct Matching of the Fokker–Planck–Kolmogorov Equation »
    Arno Solin · Ella Tamir · Prakhar Verma
  • 2020 Poster: Stationary Activations for Uncertainty Calibration in Deep Learning »
    Lassi Meronen · Christabella Irwanto · Arno Solin
  • 2019 : Poster session »
    Sebastian Farquhar · Erik Daxberger · Andreas Look · Matt Benatan · Ruiyi Zhang · Marton Havasi · Fredrik Gustafsson · James A Brofos · Nabeel Seedat · Micha Livne · Ivan Ustyuzhaninov · Adam Cobb · Felix D McGregor · Patrick McClure · Tim R. Davidson · Gaurush Hiranandani · Sanjeev Arora · Masha Itkina · Didrik Nielsen · Will Harvey · Matias Valdenegro-Toro · Stefano Peluchetti · Riccardo Moriconi · Tianyu Cui · Vaclav Smidl · Taylan Cemgil · Jack Fitzsimons · He Zhao · willit · mariana vargas vieyra · Apratim Bhattacharyya · Rahul Sharma · Geoffroy Dubourg-Felonneau · Jonathan Warrell · Slava Voloshynovskiy · Mihaela Rosca · Jiaming Song · Andrew Ross · Homa Fashandi · Ruiqi Gao · Hooshmand Shokri Razaghi · Joshua Chang · Tim Xiao · Vanessa Boehm · Giorgio Giannone · Ranganath Krishnan · Joe Davison · Arsenii Ashukha · Jeremiah Liu · Sicong Huang · Evgenii Nikishin · Sunho Park · Nilesh Ahuja · Mahesh Subedar · roman.novak · Artyom Gadetsky · Jhosimar Arias Figueroa · Tim G. J. Rudner · Waseem Aslam · Adrián Csiszárik · John Moberg · Ali Hebbal · Kathrin Grosse · Pekka Marttinen · Bang An · Hlynur Jónsson · Samuel Kessler · Abhishek Kumar · Michael Figurnov · Omesh Tickoo · Steindor Saemundsson · Ari Heljakka · Dániel Varga · Niklas Heim · Simone Rossi · Max Laves · Waseem Gharbieh · Nick Roberts · Luis Armando Pérez Rey · Matthew Willetts · Prithvi Chakrabarty · Sumedh Ghaisas · Carl Shneider · Wray Buntine · Kamil Adamczewski · Xavier Gitiaux · Suwen Lin · Hao Fu · Gunnar Rätsch · Aidan Gomez · Erik Bodin · Dinh Phung · Lennart Svensson · Juliano Tusi Amaral Laganá Pinto · Milad Alizadeh · Jianzhun Du · Kevin Murphy · Beatrix Benkő · Shashaank Vattikuti · Jonathan Gordon · Chris Kanan · Sontje Ihler · Darin Graham · Michael Teng · Louis Kirsch · Tomas Pevny · Taras Holotyak
  • 2019 Poster: Regularizing Trajectory Optimization with Denoising Autoencoders »
    Rinu Boney · Norman Di Palo · Mathias Berglund · Alexander Ilin · Juho Kannala · Antti Rasmus · Harri Valpola
  • 2018 Poster: Infinite-Horizon Gaussian Processes »
    Arno Solin · James Hensman · Richard Turner