Timezone: »
Data Efficient Domain Adaptation using FiLM
Sinjini Mitra · Rushil Anirudh · Jayaraman Thiagarajan · Pavan Turaga
Event URL: https://eventhosts.gather.town/app/kR7ip0Bhhn8BXuMD/wiml-workshop-2021 »
GANs or Generative Adversarial Networks, have been a cornerstone in the machine learning and computer vision community due to their ability to generate high-quality realistic images by learning the underlying complex distributions in the training data. On the other hand, adaptation of generative models by retraining on the target dataset is currently computationally extensive. Therefore, there exists a need for data efficient transfer of generative models. We hypothesize that approaches which seek to align the source and target distributions generally tend to overfit the target data. Alternatively, we propose linear modulation of features in a non-linear network (FiLM) which allows fine grain control over the learned parameters during retraining. Originally introduced for visual reasoning, FiLM learns scaling and bias parameters gamma and beta respectively, that help close the divergence during source and target distributions. Using a DCGAN, we obtain results on the MNIST digits dataset while adapting it to the Rotated MNIST dataset. As future work, we hope to explore the performance of FiLM in our proposed GAN structure in conjunction with further fine-tuning and manipulation of batchnorm statistics.
Author Information
Sinjini Mitra (Arizona State University)
Rushil Anirudh (Lawrence Livermore National Laboratory)
Jayaraman Thiagarajan (Lawrence Livermore National Laboratory)
Pavan Turaga (Arizona State University)
More from the Same Authors
-
2021 : Multi-Domain Ensembles for Domain Generalization »
Kowshik Thopalli · Sameeksha Katoch · Jayaraman Thiagarajan · Pavan Turaga · Andreas Spanias -
2021 : Re-labeling Domains Improves Multi-Domain Generalization »
Kowshik Thopalli · Pavan Turaga · Jayaraman Thiagarajan -
2021 : Unsupervised Attribute Alignment for Characterizing Distribution Shift »
Matthew Olson · Rushil Anirudh · Jayaraman Thiagarajan · Timo Bremer · Weng-Keen Wong · Shusen Liu -
2021 : Geometric Priors for Scientific Generative Models in Inertial Confinement Fusion »
Ankita Shukla · Rushil Anirudh · Eugene Kur · Jayaraman Thiagarajan · Timo Bremer · Brian K Spears · Tammy Ma · Pavan Turaga -
2022 : Learning Free Energy Pathways through Reinforcement Learning of Adaptive Steered Molecular Dynamics »
Nicholas Ho · John Kevin Cava · John Vant · Ankita Shukla · Jacob Miratsky · Pavan Turaga · Ross Maciejewski · Abhishek Singharoy -
2022 Spotlight: Single Model Uncertainty Estimation via Stochastic Data Centering »
Jayaraman Thiagarajan · Rushil Anirudh · Vivek Sivaraman Narayanaswamy · Timo Bremer -
2022 Poster: Single Model Uncertainty Estimation via Stochastic Data Centering »
Jayaraman Thiagarajan · Rushil Anirudh · Vivek Sivaraman Narayanaswamy · Timo Bremer -
2021 Poster: Designing Counterfactual Generators using Deep Model Inversion »
Jayaraman Thiagarajan · Vivek Sivaraman Narayanaswamy · Deepta Rajan · Jia Liang · Akshay Chaudhari · Andreas Spanias -
2019 : Afternoon Coffee Break & Poster Session »
Heidi Komkov · Stanislav Fort · Zhaoyou Wang · Rose Yu · Ji Hwan Park · Samuel Schoenholz · Taoli Cheng · Ryan-Rhys Griffiths · Chase Shimmin · Surya Karthik Mukkavili · Philippe Schwaller · Christian Knoll · Yangzesheng Sun · Keiichi Kisamori · Gavin Graham · Gavin Portwood · Hsin-Yuan Huang · Paul Novello · Moritz Munchmeyer · Anna Jungbluth · Daniel Levine · Ibrahim Ayed · Steven Atkinson · Jan Hermann · Peter Grönquist · · Priyabrata Saha · Yannik Glaser · Lingge Li · Yutaro Iiyama · Rushil Anirudh · Maciej Koch-Janusz · Vikram Sundar · Francois Lanusse · Auralee Edelen · Jonas Köhler · Jacky H. T. Yip · jiadong guo · Xiangyang Ju · Adi Hanuka · Adrian Albert · Valentina Salvatelli · Mauro Verzetti · Javier Duarte · Eric Moreno · Emmanuel de Bézenac · Athanasios Vlontzos · Alok Singh · Thomas Klijnsma · Brad Neuberg · Paul Wright · Mustafa Mustafa · David Schmidt · Steven Farrell · Hao Sun -
2019 : Morning Coffee Break & Poster Session »
Eric Metodiev · Keming Zhang · Markus Stoye · Randy Churchill · Soumalya Sarkar · Miles Cranmer · Johann Brehmer · Danilo Jimenez Rezende · Peter Harrington · AkshatKumar Nigam · Nils Thuerey · Lukasz Maziarka · Alvaro Sanchez Gonzalez · Atakan Okan · James Ritchie · N. Benjamin Erichson · Harvey Cheng · Peihong Jiang · Seong Ho Pahng · Samson Koelle · Sami Khairy · Adrian Pol · Rushil Anirudh · Jannis Born · Benjamin Sanchez-Lengeling · Brian Timar · Rhys Goodall · Tamás Kriváchy · Lu Lu · Thomas Adler · Nathaniel Trask · Noëlie Cherrier · Tomohiko Konno · Muhammad Kasim · Tobias Golling · Zaccary Alperstein · Andrei Ustyuzhanin · James Stokes · Anna Golubeva · Ian Char · Ksenia Korovina · Youngwoo Cho · Chanchal Chatterjee · Tom Westerhout · Gorka Muñoz-Gil · Juan Zamudio-Fernandez · Jennifer Wei · Brian Lee · Johannes Kofler · Bruce Power · Nikita Kazeev · Andrey Ustyuzhanin · Artem Maevskiy · Pascal Friederich · Arash Tavakoli · Willie Neiswanger · Bohdan Kulchytskyy · sindhu hari · Paul Leu · Paul Atzberger -
2019 : Poster Session »
Jonathan Scarlett · Piotr Indyk · Ali Vakilian · Adrian Weller · Partha P Mitra · Benjamin Aubin · Bruno Loureiro · Florent Krzakala · Lenka Zdeborová · Kristina Monakhova · Joshua Yurtsever · Laura Waller · Hendrik Sommerhoff · Michael Moeller · Rushil Anirudh · Shuang Qiu · Xiaohan Wei · Zhuoran Yang · Jayaraman Thiagarajan · Salman Asif · Michael Gillhofer · Johannes Brandstetter · Sepp Hochreiter · Felix Petersen · Dhruv Patel · Assad Oberai · Akshay Kamath · Sushrut Karmalkar · Eric Price · Ali Ahmed · Zahra Kadkhodaie · Sreyas Mohan · Eero Simoncelli · Carlos Fernandez-Granda · Oscar Leong · Wesam Sakla · Rebecca Willett · Stephan Hoyer · Jascha Sohl-Dickstein · Sam Greydanus · Gauri Jagatap · Chinmay Hegde · Michael Kellman · Jonathan Tamir · Nouamane Laanait · Ousmane Dia · Mirco Ravanelli · Jonathan Binas · Negar Rostamzadeh · Shirin Jalali · Tiantian Fang · Alex Schwing · Sébastien Lachapelle · Philippe Brouillard · Tristan Deleu · Simon Lacoste-Julien · Stella Yu · Arya Mazumdar · Ankit Singh Rawat · Yue Zhao · Jianshu Chen · Xiaoyang Li · Hubert Ramsauer · Gabrio Rizzuti · Nikolaos Mitsakos · Dingzhou Cao · Thomas Strohmer · Yang Li · Pei Peng · Gregory Ongie