Timezone: »
Site for the workshop: https://sites.google.com/view/nips2018causallearning/home
The route from machine learning to artificial intelligence remains uncharted. Recent efforts describe some of the conceptual problems that lie along this route [4, 9, 12]. The goal of this workshop is to investigate how much progress is possible by framing these problems beyond learning correlations, that is, by uncovering and leveraging causal relations:
1. Machine learning algorithms solve statistical problems (e.g. maximum likelihood) as a proxy to solve tasks of interest (e.g. recognizing objects). Unfortunately, spurious correlations and biases are often easier to learn than the task itself [14], leading to unreliable or unfair predictions. This phenomenon can be framed as causal confounding.
2. Machines trained on large pools of i.i.d. data often crash confidently when deployed in different circumstances (e.g., adversarial examples, dataset biases [18]). In contrast, humans seek prediction rules robust across multiple conditions. Allowing machines to learn robust rules from multiple environments can be framed as searching for causal invariances [2, 11, 16, 17].
3. Humans benefit from discrete structures to reason. Such structures seem less useful to learning machines. For instance, neural machine translation systems outperform those that model language structure. However, the purpose of this structure might not be modeling common sentences, but to help us formulate new ones. Modeling new potential sentences rather than observed ones is a form of counterfactual reasoning [8, 9].
4. Intelligent agents do not only observe, but also shape the world with actions. Maintaining plausible causal models of the world allows to build intuitions, as well as to design intelligent experiments and interventions to test them [16, 17]. Is causal understanding necessary for efficient reinforcement learning?
5. Humans learn compositionally; after learning simple skills, we are able to recombine them quickly to solve new tasks. Such abilities have so far eluded our machine learning systems. Causal models are compositional, so they might offer a solution to this puzzle [4].
6. Finally, humans are able to digest large amounts of unsupervised signals into a causal model of the world. Humans can learn causal affordances, that is, imagining how to manipulate new objects to achieve goals, and the outcome of doing so. Humans rely on a simple blueprint for a complex world: models that contain the correct causal structures, but ignore irrelevant details [16, 17].
We cannot address these problems by simply performing inference on known causal graphs. We need to learn from data to discover plausible causal models, and to construct predictors that are robust to distributional shifts. Furthermore, much prior work has focused on estimating explicit causal structures from data, but these methods are often unscalable, rely on untestable assumptions like faithfulness or acyclicity, and are difficult to incorporate into high-dimensional, complex and nonlinear machine learning pipelines. Instead of considering the task of estimating causal graphs as their final goal, learning machines may use notions from causation indirectly to ignore biases, generalize across distributions, leverage structure to reason, design efficient interventions, benefit from compositionality, and build causal models of the world in an unsupervised way.
Call for papers
Submit your anonymous, NIPS-formatted manuscript here[https://easychair.org/cfp/NIPSCL2018]. All accepted submissions will require a poster presentation. A selection of submissions will be awarded a 5-minute spotlight presentation. We welcome conceptual, thought-provoking material, as well as research agendas, open problems, new tasks, and datasets.
Submission deadline: 28 October 2018
Acceptance notifications: 9 November 2018
Schedule:
See https://sites.google.com/view/nips2018causallearning/home for the up-to-date schedule.
Speakers:
Elias Bareinboim
David Blei
Nicolai Meinshausen
Bernhard Schölkopf
Isabelle Guyon
Csaba Szepesvari
Pietro Perona
References
1. Krzysztof Chalupka, Pietro Perona, Frederick Eberhardt (2015): Visual Causal Feature Learning [https://arxiv.org/abs/1412.2309]
2. Christina Heinze-Deml, Nicolai Meinshausen (2018): Conditional Variance Penalties and Domain Shift Robustness [https://arxiv.org/abs/1710.11469]
3. Fredrik D. Johansson, Uri Shalit, David Sontag (2016): Learning Representations for Counterfactual Inference [https://arxiv.org/abs/1605.03661]
4. Brenden Lake (2014): Towards more human-like concept learning in machines: compositionality, causality, and learning-to-learn [https://dspace.mit.edu/handle/1721.1/95856]
5. Brenden M. Lake, Tomer D. Ullman, Joshua B. Tenenbaum, Samuel J. Gershman (2016): Building Machines That Learn and Think Like People [https://arxiv.org/abs/1604.00289]
6. David Lopez-Paz, Krikamol Muandet, Bernhard Schölkopf, Ilya Tolstikhin (2015): Towards a Learning Theory of Cause-Effect Inference [https://arxiv.org/abs/1309.6779]
7. David Lopez-Paz, Robert Nishihara, Soumith Chintala, Bernhard Schölkopf, Léon Bottou (2017): Discovering Causal Signals in Images [https://arxiv.org/abs/1605.08179]
8. Judea Pearl (2009): Causality: Models, Reasoning, and Inference [http://bayes.cs.ucla.edu/BOOK-2K/]
9. Judea Pearl (2018): The Seven Pillars of Causal Reasoning with Reflections on Machine Learning [http://ftp.cs.ucla.edu/pub/statser/r481.pdf]
10. Jonas Peters, Joris Mooij, Dominik Janzing, Bernhard Schölkopf (2014): Causal Discovery with Continuous Additive Noise Models [https://arxiv.org/abs/1309.6779]
11. Jonas Peters, Peter Bühlmann, Nicolai Meinshausen (2016): Causal inference using invariant prediction: identification and confidence intervals [https://arxiv.org/abs/1501.01332]
12. Jonas Peters, Dominik Janzing, Bernhard Schölkopf (2017): Elements of Causal Inference: Foundations and Learning Algorithms [https://mitpress.mit.edu/books/elements-causal-inference]
13. Peter Spirtes, Clark Glymour, Richard Scheines (2001): Causation, Prediction, and Search [http://cognet.mit.edu/book/causation-prediction-and-search]
14. Bob L. Sturm (2016): The HORSE conferences [http://c4dm.eecs.qmul.ac.uk/horse2016/, http://c4dm.eecs.qmul.ac.uk/horse2017/]
15. Dustin Tran, David M. Blei (2017): Implicit Causal Models for Genome-wide Association Studies [https://arxiv.org/abs/1710.10742]
16. Michael Waldmann (2017): The Oxford Handbook of Causal Reasoning [https://global.oup.com/academic/product/the-oxford-handbook-of-causal-reasoning-9780199399550?cc=us&lang=en]
17. James Woodward (2005): Making Things Happen: A Theory of Causal Explanation [https://global.oup.com/academic/product/making-things-happen-9780195189537?cc=us&lang=en&]
18. Antonio Torralba, Alyosha Efros (2011): Unbiased look at dataset bias. [http://people.csail.mit.edu/torralba/publications/datasetscvpr11.pdf]
Fri 6:15 a.m. - 6:30 a.m.
|
Opening Remarks
(
Opening talk
)
Speaker: David Lopez-Paz |
David Lopez-Paz 🔗 |
Fri 6:30 a.m. - 7:00 a.m.
|
Learning Independent Mechanisms
(
Invited talk
)
|
Bernhard Schölkopf 🔗 |
Fri 7:00 a.m. - 7:30 a.m.
|
From Micro-Variables to Macro-Causes
(
Invited talk
)
|
Pietro Perona 🔗 |
Fri 8:00 a.m. - 8:30 a.m.
|
Causality and Transfer Learning
(
Invited Talk
)
|
Elias Bareinboim 🔗 |
Fri 8:30 a.m. - 9:00 a.m.
|
Evaluating Causation Coefficients
(
Invited talk
)
|
Isabelle Guyon 🔗 |
Fri 9:00 a.m. - 9:30 a.m.
|
The Blessings of Multiple Causes
(
Invited talk
)
|
David Blei 🔗 |
Fri 11:00 a.m. - 11:30 a.m.
|
Causality and Distributional Robustness
(
Invited talk
)
|
Nicolai Meinshausen 🔗 |
Fri 11:30 a.m. - 12:00 p.m.
|
Model-free vs. Model-based Learning in a Causal World: Some Stories from Online Learning to Rank
(
Invited talk
)
|
Csaba Szepesvari 🔗 |
Fri 12:30 p.m. - 2:00 p.m.
|
Datasets and Benchmarks for Causal Learning
(
Panel Discussion
)
|
Csaba Szepesvari · Isabelle Guyon · Nicolai Meinshausen · David Blei · Elias Bareinboim · Bernhard Schölkopf · Pietro Perona 🔗 |
Fri 2:00 p.m. - 2:05 p.m.
|
Woulda, Coulda, Shoulda: Counterfactually-Guided Policy Search
(
Spotlight
)
|
🔗 |
Fri 2:05 p.m. - 2:10 p.m.
|
Cause-Effect Deep Information Bottleneck For Incomplete Covariates
(
Spotlight
)
|
Mario Wieser 🔗 |
Fri 2:10 p.m. - 2:15 p.m.
|
NonSENS: Non-Linear SEM Estimation using Non-Stationarity
(
Spotlight
)
|
🔗 |
Fri 2:15 p.m. - 2:20 p.m.
|
Rule-Based Sentence Quality Modeling and Assessment using Deep LSTM Features
(
Spotlight
)
|
Aishwarya Pagalla 🔗 |
Fri 2:20 p.m. - 2:25 p.m.
|
The Case for Evaluating Causal Models Using Interventional Measures and Empirical Data
(
Spotlight
)
|
Amanda Gentzel 🔗 |
Fri 2:25 p.m. - 2:30 p.m.
|
Marginalized Off-Policy Evaluation for Reinforcement Learning
(
Spotlight
)
|
Yifei Ma 🔗 |
Fri 2:30 p.m. - 2:35 p.m.
|
Domain Adaptation by Using Causal Inference to Predict Invariant Conditional Distributions
(
Spotlight
)
|
🔗 |
Fri 2:35 p.m. - 2:40 p.m.
|
Learning Predictive Models That Transport
(
Spotlight
)
|
🔗 |
Fri 2:40 p.m. - 2:45 p.m.
|
Causal Confusion in Imitation Learning
(
Spotlight
)
|
🔗 |
Fri 2:45 p.m. - 2:50 p.m.
|
Causality in Physics and Effective Theories of Agency
(
Spotlight
)
|
🔗 |
Fri 3:00 p.m. - 5:00 p.m.
|
Real Defect Image Classification through Hierarchical Data Augmentation
(
Poster
)
|
Jiman Kim 🔗 |
Fri 3:00 p.m. - 5:00 p.m.
|
Stability of Linear Structural Equation Model of Causal Inference
(
Poster
)
|
🔗 |
Fri 3:00 p.m. - 5:00 p.m.
|
Rule Discovery for Exploratory Causal Reasoning
(
Poster
)
|
🔗 |
Fri 3:00 p.m. - 5:00 p.m.
|
A Bayesian Solution to the M-Bias Problem
(
Poster
)
|
David Rohde 🔗 |
Fri 3:00 p.m. - 5:00 p.m.
|
Quantifying Context-Dependent Causal Influences
(
Poster
)
|
Todd Coleman 🔗 |
Fri 3:00 p.m. - 5:00 p.m.
|
Entropic Latent Variable Discovery
(
Poster
)
|
🔗 |
Fri 3:00 p.m. - 5:00 p.m.
|
Intervention Harvesting for Context-Dependent Examination-Bias Estimation
(
Poster
)
|
Aman Agarwal 🔗 |
Fri 3:00 p.m. - 5:00 p.m.
|
Learning Robotic Manipulation through Visual Planning and Acting
(
Poster
)
|
🔗 |
Fri 3:00 p.m. - 5:00 p.m.
|
Off-policy learning for causal advertising
(
Poster
)
|
🔗 |
Fri 3:00 p.m. - 5:00 p.m.
|
Detecting switching causal interactions using hierarchical segmentation approach
(
Poster
)
|
Jeric Briones 🔗 |
Fri 3:00 p.m. - 5:00 p.m.
|
Consistency and Computation for Regularized Maximum Likelihood Estimation of Multivariate Hawkes Processes
(
Poster
)
|
Anran Hu 🔗 |
Fri 3:00 p.m. - 5:00 p.m.
|
Modularization of End-to-End Learning: Case Study in Arcade Games
(
Poster
)
|
Andrew Melnik 🔗 |
Fri 3:00 p.m. - 5:00 p.m.
|
Weighted Tensor Completion for Time-Series Causal Inference
(
Poster
)
|
Debmalya Mandal 🔗 |
Fri 3:00 p.m. - 5:00 p.m.
|
Stochastic Complexity for Testing Conditional Independence on Discrete Data
(
Poster
)
|
Alexander Marx 🔗 |
Fri 3:00 p.m. - 5:00 p.m.
|
CAB: Continuous Adaptive Blending Estimator for Policy Evaluation and Learning
(
Poster
)
|
Yi Su · Lequn Wang 🔗 |
Author Information
Martin Arjovsky (New York University)
Christina Heinze-Deml (ETH Zurich)
Anna Klimovskaia (ETH Zurich)
Maxime Oquab (Facebook AI Research)
Leon Bottou (Facebook AI Research)
Léon Bottou received a Diplôme from l'Ecole Polytechnique, Paris in 1987, a Magistère en Mathématiques Fondamentales et Appliquées et Informatiques from Ecole Normale Supérieure, Paris in 1988, and a PhD in Computer Science from Université de Paris-Sud in 1991. He joined AT&T Bell Labs from 1991 to 1992 and AT&T Labs from 1995 to 2002. Between 1992 and 1995 he was chairman of Neuristique in Paris, a small company pioneering machine learning for data mining applications. He has been with NEC Labs America in Princeton since 2002. Léon's primary research interest is machine learning. His contributions to this field address theory, algorithms and large scale applications. Léon's secondary research interest is data compression and coding. His best known contribution in this field is the DjVu document compression technology (http://www.djvu.org.) Léon published over 70 papers and is serving on the boards of JMLR and IEEE TPAMI. He also serves on the scientific advisory board of Kxen Inc .
David Lopez-Paz (Facebook AI Research)
More from the Same Authors
-
2021 : On the Relation between Distributionally Robust Optimization and Data Curation »
Agnieszka Słowik · Leon Bottou -
2021 : On the Relation between Distributionally Robust Optimization and Data Curation »
Agnieszka Słowik · Leon Bottou -
2021 : Poster: Algorithmic Bias and Data Bias: Understanding the Relation between Distributionally Robust Optimization and Data Curation »
Agnieszka Słowik · Leon Bottou -
2022 : Pre-train, fine-tune, interpolate: a three-stage strategy for domain generalization »
Alexandre Rame · Jianyu Zhang · Leon Bottou · David Lopez-Paz -
2022 Workshop: INTERPOLATE — First Workshop on Interpolation Regularizers and Beyond »
Yann Dauphin · David Lopez-Paz · Vikas Verma · Boyi Li -
2022 Poster: The Effects of Regularization and Data Augmentation are Class Dependent »
Randall Balestriero · Leon Bottou · Yann LeCun -
2021 : Algorithmic Bias and Data Bias: Understanding the Relation between Distributionally Robust Optimization and Data Curation »
Agnieszka Słowik · Leon Bottou -
2020 Poster: Low Distortion Block-Resampling with Spatially Stochastic Networks »
Sarah Hong · Martin Arjovsky · Darryl Barnhart · Ian Thompson -
2019 Poster: Learning about an exponential amount of conditional distributions »
Mohamed Ishmael Belghazi · Maxime Oquab · David Lopez-Paz -
2019 Poster: Cold Case: The Lost MNIST Digits »
Chhavi Yadav · Leon Bottou -
2019 Spotlight: Cold Case: The Lost MNIST Digits »
Chhavi Yadav · Leon Bottou -
2018 : Opening Remarks »
David Lopez-Paz -
2018 Workshop: Smooth Games Optimization and Machine Learning »
Simon Lacoste-Julien · Ioannis Mitliagkas · Gauthier Gidel · Vasilis Syrgkanis · Eva Tardos · Leon Bottou · Sebastian Nowozin -
2018 Poster: SING: Symbol-to-Instrument Neural Generator »
Alexandre Defossez · Neil Zeghidour · Nicolas Usunier · Leon Bottou · Francis Bach -
2017 : Geometrical Insights for Unsupervised Learning »
Leon Bottou -
2017 : Looking for a Missing Signal »
Leon Bottou -
2017 Poster: Improved Training of Wasserstein GANs »
Ishaan Gulrajani · Faruk Ahmed · Martin Arjovsky · Vincent Dumoulin · Aaron Courville -
2017 Poster: Gradient Episodic Memory for Continual Learning »
David Lopez-Paz · Marc'Aurelio Ranzato -
2016 : Welcome »
David Lopez-Paz · Alec Radford · Leon Bottou -
2016 Workshop: Adversarial Training »
David Lopez-Paz · Leon Bottou · Alec Radford -
2015 Workshop: Optimization for Machine Learning (OPT2015) »
Suvrit Sra · Alekh Agarwal · Leon Bottou · Sashank J. Reddi -
2015 Poster: BACKSHIFT: Learning causal cyclic graphs from unknown shift interventions »
Dominik Rothenhäusler · Christina Heinze-Deml · Jonas Peters · Nicolai Meinshausen -
2014 Workshop: Learning Semantics »
Cedric Archambeau · Antoine Bordes · Leon Bottou · Chris J Burges · David Grangier -
2014 Workshop: Deep Learning and Representation Learning »
Andrew Y Ng · Yoshua Bengio · Adam Coates · Roland Memisevic · Sharanyan Chetlur · Geoffrey E Hinton · Shamim Nemati · Bryan Catanzaro · Surya Ganguli · Herbert Jaeger · Phil Blunsom · Leon Bottou · Volodymyr Mnih · Chen-Yu Lee · Rich M Schwartz -
2013 Workshop: NIPS 2013 Workshop on Causality: Large-scale Experiment Design and Inference of Causal Mechanisms »
Isabelle Guyon · Leon Bottou · Bernhard Schölkopf · Alexander Statnikov · Evelyne Viegas · james m robins -
2011 Workshop: Learning Semantics »
Antoine Bordes · Jason E Weston · Ronan Collobert · Leon Bottou -
2007 Tutorial: Learning Using Many Examples »
Leon Bottou · Andrew W Moore -
2007 Poster: The Tradeoffs of Large Scale Learning »
Leon Bottou · Olivier Bousquet