Timezone: »
Understanding the predictions of a machine learning model can be as crucial as the model's accuracy in many application domains. However, the black-box nature of most highly-accurate (complex) models is a major hindrance to their interpretability. To address this issue, we introduce the symbolic metamodeling framework — a general methodology for interpreting predictions by converting "black-box" models into "white-box" functions that are understandable to human subjects. A symbolic metamodel is a model of a model, i.e., a surrogate model of a trained (machine learning) model expressed through a succinct symbolic expression that comprises familiar mathematical functions and can be subjected to symbolic manipulation. We parameterize symbolic metamodels using Meijer G-functions — a class of complex-valued contour integrals that depend on scalar parameters, and whose solutions reduce to familiar elementary, algebraic, analytic and closed-form functions for different parameter settings. This parameterization enables efficient optimization of metamodels via gradient descent, and allows discovering the functional forms learned by a machine learning model with minimal a priori assumptions. We show that symbolic metamodeling provides an all-encompassing framework for model interpretation — all common forms of global and local explanations of a model can be analytically derived from its symbolic metamodel.
Author Information
Ahmed Alaa (UCLA)
Mihaela van der Schaar (University of Cambridge, Alan Turing Institute and UCLA)
More from the Same Authors
-
2022 : Closing Remarks »
Cheng Zhang · Mihaela van der Schaar -
2022 : Panel Discussion »
Cheng Zhang · Mihaela van der Schaar · Ilya Shpitser · Aapo Hyvarinen · Yoshua Bengio · Bernhard Schölkopf -
2022 : Opening Remarks »
Cheng Zhang · Mihaela van der Schaar -
2021 : Invited talk #5: Mihaela van der Schaar »
Mihaela van der Schaar -
2020 : Q&A for invited speaker, Mihaela van der Schaar »
Mihaela van der Schaar -
2020 : Interpretable AutoML: Powering the machine learning revolution in healthcare in the era of Covid-19 and beyond »
Mihaela van der Schaar -
2020 Poster: When and How to Lift the Lockdown? Global COVID-19 Scenario Analysis and Policy Assessment using Compartmental Gaussian Processes »
Zhaozhi Qian · Ahmed Alaa · Mihaela van der Schaar -
2020 Oral: When and How to Lift the Lockdown? Global COVID-19 Scenario Analysis and Policy Assessment using Compartmental Gaussian Processes »
Zhaozhi Qian · Ahmed Alaa · Mihaela van der Schaar -
2019 Poster: Attentive State-Space Modeling of Disease Progression »
Ahmed Alaa · Mihaela van der Schaar -
2019 Poster: Differentially Private Bagging: Improved utility and cheaper privacy than subsample-and-aggregate »
James Jordon · Jinsung Yoon · Mihaela van der Schaar -
2019 Poster: Conditional Independence Testing using Generative Adversarial Networks »
Alexis Bellot · Mihaela van der Schaar -
2019 Spotlight: Conditional Independence Testing using Generative Adversarial Networks »
Alexis Bellot · Mihaela van der Schaar -
2018 Poster: Forecasting Treatment Responses Over Time Using Recurrent Marginal Structural Networks »
Bryan Lim · Ahmed M. Alaa · Mihaela van der Schaar -
2017 : Coffee break and Poster Session II »
Mohamed Kane · Albert Haque · Vagelis Papalexakis · John Guibas · Peter Li · Carlos Arias · Eric Nalisnick · Padhraic Smyth · Frank Rudzicz · Xia Zhu · Theodore Willke · Noemie Elhadad · Hans Raffauf · Harini Suresh · Paroma Varma · Yisong Yue · Ognjen (Oggi) Rudovic · Luca Foschini · Syed Rameel Ahmad · Hasham ul Haq · Valerio Maggio · Giuseppe Jurman · Sonali Parbhoo · Pouya Bashivan · Jyoti Islam · Mirco Musolesi · Chris Wu · Alexander Ratner · Jared Dunnmon · Cristóbal Esteban · Aram Galstyan · Greg Ver Steeg · Hrant Khachatrian · Marc Górriz · Mihaela van der Schaar · Anton Nemchenko · Manasi Patwardhan · Tanay Tandon -
2017 Poster: DPSCREEN: Dynamic Personalized Screening »
Kartik Ahuja · William Zame · Mihaela van der Schaar -
2017 Poster: Deep Multi-task Gaussian Processes for Survival Analysis with Competing Risks »
Ahmed M. Alaa · Mihaela van der Schaar -
2017 Spotlight: Deep Multi-task Gaussian Processes for Survival Analysis with Competing Risks »
Ahmed M. Alaa · Mihaela van der Schaar -
2017 Poster: Bayesian Inference of Individualized Treatment Effects using Multi-task Gaussian Processes »
Ahmed M. Alaa · Mihaela van der Schaar