Timezone: »

 
Distributionally Robust Group Backwards Compatibility
Martin Bertran · Natalia Martinez · Guillermo Sapiro

@
in Distribution shifts: connecting methods and applications (DistShift) »
Event URL: https://openreview.net/forum?id=pQTefY7pya6 »

Machine learning models are updated as new data is acquired or new architectures are developed. These updates usually increase model performance, but may introduce backward compatibility errors, where individual users or groups of users see their performance on the updated model adversely affected. This problem can also be present when training datasets do not accurately reflect overall population demographics, with some groups having overall lower participation in the data collection process, posing a significant fairness concern. We analyze how ideas from distributional robustness and minimax fairness can aid backward compatibility in this scenario, and propose two methods to directly address this issue. Our theoretical analysis is backed by experimental results on CIFAR-10, CelebA, and Waterbirds, three standard image classification datasets.

Author Information

Martin Bertran (Duke University)
Natalia Martinez (Duke University)
Guillermo Sapiro (Duke University)

More from the Same Authors