`

Timezone: »

 
Learning Invariant Representations with Missing Data
Mark Goldstein · Adriel Saporta · Aahlad Puli · Rajesh Ranganath · Andrew Miller
Event URL: https://openreview.net/forum?id=tO_6s92BaDZ »

Spurious correlations allow deep models to predict well during training but poorly on related test populations. Recent work has shown that models that satisfy particular independencies involving the correlation-inducing nuisance variable have guarantees on their test performance. However, enforcing independencies requires nuisances to be observed during training. But nuisances such as demographics or image background labels are often missing. Enforcing independence on just the observed data does not imply independence on the entire population. In this work, we derive the missing-mmd estimator used for invariance objectives under missing nuisances. On simulations, missing-mmds enable improvements in test performance similar to those achieved by using fully-observed data.

Author Information

Mark Goldstein (New York University)
Adriel Saporta (Stanford University)
Aahlad Puli (NYU)
Rajesh Ranganath (New York University)
Andrew Miller (Apple)

More from the Same Authors

  • 2021 Spotlight: Offline RL Without Off-Policy Evaluation »
    David Brandfonbrener · Will Whitney · Rajesh Ranganath · Joan Bruna
  • 2021 : Learning to Accelerate MR Screenings »
    Raghav Singhal · Mukund Sudarshan · Angela Tong · Daniel Sodickson · Rajesh Ranganath
  • 2021 : Individual treatment effect estimation in the presence of unobserved confounding based on a fixed relative treatment effect »
    Wouter van Amsterdam · Rajesh Ranganath
  • 2021 : Quantile Filtered Imitation Learning »
    David Brandfonbrener · Will Whitney · Rajesh Ranganath · Joan Bruna
  • 2021 Poster: Inverse-Weighted Survival Games »
    Xintian Han · Mark Goldstein · Aahlad Puli · Thomas Wies · Adler Perotte · Rajesh Ranganath
  • 2021 Poster: Offline RL Without Off-Policy Evaluation »
    David Brandfonbrener · Will Whitney · Rajesh Ranganath · Joan Bruna
  • 2020 Poster: Deep Direct Likelihood Knockoffs »
    Mukund Sudarshan · Wesley Tansey · Rajesh Ranganath
  • 2020 Poster: General Control Functions for Causal Effect Estimation from IVs »
    Aahlad Puli · Rajesh Ranganath
  • 2020 Poster: X-CAL: Explicit Calibration for Survival Analysis »
    Mark Goldstein · Xintian Han · Aahlad Puli · Adler Perotte · Rajesh Ranganath
  • 2020 Poster: Causal Estimation with Functional Confounders »
    Aahlad Puli · Adler Perotte · Rajesh Ranganath
  • 2019 : Coffee break, posters, and 1-on-1 discussions »
    Julius von Kügelgen · David Rohde · Candice Schumann · Grace Charles · Victor Veitch · Vira Semenova · Mert Demirer · Vasilis Syrgkanis · Suraj Nair · Aahlad Puli · Masatoshi Uehara · Aditya Gopalan · Yi Ding · Ignavier Ng · Khashayar Khosravi · Eli Sherman · Shuxi Zeng · Aleksander Wieczorek · Hao Liu · Kyra Gan · Jason Hartford · Miruna Oprescu · Alexander D'Amour · Jörn Boehnke · Yuta Saito · Théophile Griveau-Billion · Chirag Modi · Shyngys Karimov · Jeroen Berrevoets · Logan Graham · Imke Mayer · Dhanya Sridhar · Issa Dahabreh · Alan Mishler · Duncan Wadsworth · Khizar Qureshi · Rahul Ladhania · Gota Morishita · Paul Welle
  • 2019 Poster: Energy-Inspired Models: Learning with Sampler-Induced Distributions »
    John Lawson · George Tucker · Bo Dai · Rajesh Ranganath
  • 2018 : Poster Session I »
    Aniruddh Raghu · Daniel Jarrett · Kathleen Lewis · Elias Chaibub Neto · Nicholas Mastronarde · Shazia Akbar · Chun-Hung Chao · Henghui Zhu · Seth Stafford · Luna Zhang · Jen-Tang Lu · Changhee Lee · Adityanarayanan Radhakrishnan · Fabian Falck · Liyue Shen · Daniel Neil · Yusuf Roohani · Aparna Balagopalan · Brett Marinelli · Hagai Rossman · Sven Giesselbach · Jose Javier Gonzalez Ortiz · Edward De Brouwer · Byung-Hoon Kim · Rafid Mahmood · Tzu Ming Hsu · Antonio Ribeiro · Rumi Chunara · Agni Orfanoudaki · Kristen Severson · Mingjie Mai · Sonali Parbhoo · Albert Haque · Viraj Prabhu · Di Jin · Alena Harley · Geoffroy Dubourg-Felonneau · Xiaodan Hu · Maithra Raghu · Jonathan Warrell · Nelson Johansen · Wenyuan Li · Marko Järvenpää · Satya Narayan Shukla · Sarah Tan · Vincent Fortuin · Beau Norgeot · Yi-Te Hsu · Joel H Saltz · Veronica Tozzo · Andrew Miller · Guillaume Ausset · Azin Asgarian · Francesco Paolo Casale · Antoine Neuraz · Bhanu Pratap Singh Rawat · Turgay Ayer · Xinyu Li · Mehul Motani · Nathaniel Braman · Laetitia M Shao · Adrian Dalca · Hyunkwang Lee · Emma Pierson · Sandesh Ghimire · Yuji Kawai · Owen Lahav · Anna Goldenberg · Denny Wu · Pavitra Krishnaswamy · Colin Pawlowski · Arijit Ukil · Yuhui Zhang
  • 2018 Poster: Removing Hidden Confounding by Experimental Grounding »
    Nathan Kallus · Aahlad Puli · Uri Shalit
  • 2018 Spotlight: Removing Hidden Confounding by Experimental Grounding »
    Nathan Kallus · Aahlad Puli · Uri Shalit
  • 2017 : Contributed talk: Taylor Residual Estimators via Automatic Differentiation »
    Andrew Miller
  • 2017 : Poster Session »
    Shunsuke Horii · Heejin Jeong · Tobias Schwedes · Qing He · Ben Calderhead · Ertunc Erdil · Jaan Altosaar · Patrick Muchmore · Rajiv Khanna · Ian Gemp · Pengfei Zhang · Yuan Zhou · Chris Cremer · Maria DeYoreo · Alexander Terenin · Brendan McVeigh · Rachit Singh · Yaodong Yang · Erik Bodin · Trefor Evans · Henry Chai · Shandian Zhe · Jeffrey Ling · Vincent ADAM · Lars Maaløe · Andrew Miller · Ari Pakman · Josip Djolonga · Hong Ge
  • 2017 : Coffee break and Poster Session I »
    Nishith Khandwala · Steve Gallant · Gregory Way · Aniruddh Raghu · Li Shen · Aydan Gasimova · Alican Bozkurt · William Boag · Daniel Lopez-Martinez · Ulrich Bodenhofer · Samaneh Nasiri GhoshehBolagh · Michelle Guo · Christoph Kurz · Kirubin Pillay · Kimis Perros · George H Chen · Alexandre Yahi · Madhumita Sushil · Sanjay Purushotham · Elena Tutubalina · Tejpal Virdi · Marc-Andre Schulz · Samuel Weisenthal · Bharat Srikishan · Petar Veličković · Kartik Ahuja · Andrew Miller · Erin Craig · Disi Ji · Filip Dabek · Chloé Pou-Prom · Hejia Zhang · Janani Kalyanam · Wei-Hung Weng · Harish Bhat · Hugh Chen · Simon Kohl · Mingwu Gao · Tingting Zhu · Ming-Zher Poh · Iñigo Urteaga · Antoine Honoré · Alessandro De Palma · Maruan Al-Shedivat · Pranav Rajpurkar · Matthew McDermott · Vincent Chen · Yanan Sui · Yun-Geun Lee · Li-Fang Cheng · Chen Fang · Sibt ul Hussain · Cesare Furlanello · Zeev Waks · Hiba Chougrad · Hedvig Kjellstrom · Finale Doshi-Velez · Wolfgang Fruehwirt · Yanqing Zhang · Lily Hu · Junfang Chen · Sunho Park · Gatis Mikelsons · Jumana Dakka · Stephanie Hyland · yann chevaleyre · Hyunwoo Lee · Xavier Giro-i-Nieto · David Kale · Michael Hughes · Gabriel Erion · Rishab Mehra · William Zame · Stojan Trajanovski · Prithwish Chakraborty · Kelly Peterson · Muktabh Mayank Srivastava · Amy Jin · Heliodoro Tejeda Lemus · Priyadip Ray · Tamas Madl · Joseph Futoma · Enhao Gong · Syed Rameel Ahmad · Eric Lei · Ferdinand Legros
  • 2017 Poster: Reducing Reparameterization Gradient Variance »
    Andrew Miller · Nick Foti · Alexander D'Amour · Ryan Adams
  • 2015 Poster: A Gaussian Process Model of Quasar Spectral Energy Distributions »
    Andrew Miller · Albert Wu · Jeffrey Regier · Jon McAuliffe · Dustin Lang · Mr. Prabhat · David Schlegel · Ryan Adams