Timezone: »
Poster
Neural Interaction Transparency (NIT): Disentangling Learned Interactions for Improved Interpretability
Michael Tsang · Hanpeng Liu · Sanjay Purushotham · Pavankumar Murali · Yan Liu
Neural networks are known to model statistical interactions, but they entangle the interactions at intermediate hidden layers for shared representation learning. We propose a framework, Neural Interaction Transparency (NIT), that disentangles the shared learning across different interactions to obtain their intrinsic lower-order and interpretable structure. This is done through a novel regularizer that directly penalizes interaction order. We show that disentangling interactions reduces a feedforward neural network to a generalized additive model with interactions, which can lead to transparent models that perform comparably to the state-of-the-art models. NIT is also flexible and efficient; it can learn generalized additive models with maximum $K$-order interactions by training only $O(1)$ models.
Author Information
Michael Tsang (University of Southern California)
Hanpeng Liu (University of Southern California)
Sanjay Purushotham (University of Maryland Baltimore County)
Pavankumar Murali (IBM)
Yan Liu (DiDi/University of Southern California)
More from the Same Authors
-
2022 : A Synthetic Limit Order Book Dataset for Benchmarking Forecasting Algorithms under Distributional Shift »
Defu Cao · Yousef El-Laham · Loc Trinh · Svitlana Vyetrenko · Yan Liu -
2023 Poster: Hierarchical Gaussian Mixture based Task Generative Model for Robust Meta-Learning »
Yizhou Zhang · Jingchao Ni · Wei Cheng · Zhengzhang Chen · Liang Tong · Haifeng Chen · Yan Liu -
2022 Poster: Sparse Interaction Additive Networks via Feature Interaction Detection and Sparse Selection »
James Enouen · Yan Liu -
2022 Poster: Counterfactual Neural Temporal Point Process for Estimating Causal Influence of Misinformation on Social Media »
Yizhou Zhang · Defu Cao · Yan Liu -
2021 Poster: VigDet: Knowledge Informed Neural Temporal Point Process for Coordination Detection on Social Media »
Yizhou Zhang · Karishma Sharma · Yan Liu -
2020 Poster: Multi-agent Trajectory Prediction with Fuzzy Query Attention »
Nitin Kamra · Hao Zhu · Dweep Trivedi · Ming Zhang · Yan Liu -
2020 Poster: A Scalable MIP-based Method for Learning Optimal Multivariate Decision Trees »
Haoran Zhu · Pavankumar Murali · Dzung Phan · Lam Nguyen · Jayant Kalagnanam -
2020 Poster: How does This Interaction Affect Me? Interpretable Attribution for Feature Interactions »
Michael Tsang · Sirisha Rambhatla · Yan Liu -
2019 Workshop: Learning with Temporal Point Processes »
Manuel Rodriguez · Le Song · Isabel Valera · Yan Liu · Abir De · Hongyuan Zha -
2017 : Posters 1 »
J.P. Lewis · Housam Khalifa Bashier Babiker · Zhongang Qi · Laura Rieger · Ning Xie · Filip Dabek · Koushik Nagasubramanian · Bolei Zhou · Dieuwke Hupkes · CHUN-HAO CHANG · Pamela K Douglas · Enea Ceolini · Derek Doran · Yan Liu · Fuxin Li · Randolph Goebel -
2017 : Methods 1 »
Grégoire Montavon · Michael Tsang · Marco Ancona -
2017 : Coffee break and Poster Session I »
Nishith Khandwala · Steve Gallant · Gregory Way · Aniruddh Raghu · Li Shen · Aydan Gasimova · Alican Bozkurt · William Boag · Daniel Lopez-Martinez · Ulrich Bodenhofer · Samaneh Nasiri GhoshehBolagh · Michelle Guo · Christoph Kurz · Kirubin Pillay · Kimis Perros · George H Chen · Alexandre Yahi · Madhumita Sushil · Sanjay Purushotham · Elena Tutubalina · Tejpal Virdi · Marc-Andre Schulz · Samuel Weisenthal · Bharat Srikishan · Petar Veličković · Kartik Ahuja · Andrew Miller · Erin Craig · Disi Ji · Filip Dabek · Chloé Pou-Prom · Hejia Zhang · Janani Kalyanam · Wei-Hung Weng · Harish Bhat · Hugh Chen · Simon Kohl · Mingwu Gao · Tingting Zhu · Ming-Zher Poh · Iñigo Urteaga · Antoine Honoré · Alessandro De Palma · Maruan Al-Shedivat · Pranav Rajpurkar · Matthew McDermott · Vincent Chen · Yanan Sui · Yun-Geun Lee · Li-Fang Cheng · Chen Fang · Sibt ul Hussain · Cesare Furlanello · Zeev Waks · Hiba Chougrad · Hedvig Kjellstrom · Finale Doshi-Velez · Wolfgang Fruehwirt · Yanqing Zhang · Lily Hu · Junfang Chen · Sunho Park · Gatis Mikelsons · Jumana Dakka · Stephanie Hyland · yann chevaleyre · Hyunwoo Lee · Xavier Giro-i-Nieto · David Kale · Michael Hughes · Gabriel Erion · Rishab Mehra · William Zame · Stojan Trajanovski · Prithwish Chakraborty · Kelly Peterson · Muktabh Mayank Srivastava · Amy Jin · Heliodoro Tejeda Lemus · Priyadip Ray · Tamas Madl · Joseph Futoma · Enhao Gong · Syed Rameel Ahmad · Eric Lei · Ferdinand Legros -
2016 Workshop: Learning with Tensors: Why Now and How? »
Anima Anandkumar · Rong Ge · Yan Liu · Maximilian Nickel · Qi (Rose) Yu -
2016 Poster: SPALS: Fast Alternating Least Squares via Implicit Leverage Scores Sampling »
Dehua Cheng · Richard Peng · Yan Liu · Kimis Perros -
2016 Poster: Learning Influence Functions from Incomplete Observations »
Xinran He · Ke Xu · David Kempe · Yan Liu -
2014 Poster: Fast Multivariate Spatio-temporal Analysis via Low Rank Tensor Learning »
Mohammad Taha Bahadori · Qi (Rose) Yu · Yan Liu -
2014 Spotlight: Fast Multivariate Spatio-temporal Analysis via Low Rank Tensor Learning »
Mohammad Taha Bahadori · Qi (Rose) Yu · Yan Liu