Timezone: »

 
Poster
Reconstructing Training Data From Trained Neural Networks
Niv Haim · Gal Vardi · Gilad Yehudai · Ohad Shamir · Michal Irani

Tue Nov 29 02:00 PM -- 04:00 PM (PST) @ Hall J #713
in Poster Session 2 »

Understanding to what extent neural networks memorize training data is an intriguing question with practical and theoretical implications. In this paper we show that in some cases a significant fraction of the training data can in fact be reconstructed from the parameters of a trained neural network classifier.We propose a novel reconstruction scheme that stems from recent theoretical results about the implicit bias in training neural networks with gradient-based methods.To the best of our knowledge, our results are the first to show that reconstructing a large portion of the actual training samples from a trained neural network classifier is generally possible.This has negative implications on privacy, as it can be used as an attack for revealing sensitive training data. We demonstrate our method for binary MLP classifiers on a few standard computer vision datasets.

Keywords: implicit bias · dataset reconstruction · privacy attacks
[ Paper]  [ Poster]  [ OpenReview] 

Author Information

Niv Haim (Weizmann Institute of Science)
Gal Vardi (TTI-Chicago)
Gilad Yehudai (Weizmann Institute of Technology)
Ohad Shamir (Weizmann Institute of Science)
Michal Irani (Weizmann Institute of Science)

More from the Same Authors