Timezone: »
We present a flexible framework for learning predictive models that approximately satisfy the equalized odds notion of fairness. This is achieved by introducing a general discrepancy functional that rigorously quantifies violations of this criterion. This differentiable functional is used as a penalty driving the model parameters towards equalized odds. To rigorously evaluate fitted models, we develop a formal hypothesis test to detect whether a prediction rule violates this property, the first such test in the literature. Both the model fitting and hypothesis testing leverage a resampled version of the sensitive attribute obeying equalized odds, by construction. We demonstrate the applicability and validity of the proposed framework both in regression and multi-class classification problems, reporting improved performance over state-of-the-art methods. Lastly, we show how to incorporate techniques for equitable uncertainty quantification---unbiased for each group under study---to communicate the results of the data analysis in exact terms.
Author Information
Yaniv Romano (Stanford University)
Stephen Bates (UC Berkeley)
Emmanuel Candes (Stanford University)
More from the Same Authors
-
2021 Spotlight: Conformal Prediction using Conditional Histograms »
Matteo Sesia · Yaniv Romano -
2022 Poster: Semantic uncertainty intervals for disentangled latent spaces »
Swami Sankaranarayanan · Anastasios Angelopoulos · Stephen Bates · Yaniv Romano · Phillip Isola -
2022 Poster: Robust Calibration with Multi-domain Temperature Scaling »
Yaodong Yu · Stephen Bates · Yi Ma · Michael Jordan -
2022 Invited Talk: Conformal Prediction in 2022 »
Emmanuel Candes -
2021 Oral: Adaptive Conformal Inference Under Distribution Shift »
Isaac Gibbs · Emmanuel Candes -
2021 Poster: Adaptive Conformal Inference Under Distribution Shift »
Isaac Gibbs · Emmanuel Candes -
2021 Poster: Improving Conditional Coverage via Orthogonal Quantile Regression »
Shai Feldman · Stephen Bates · Yaniv Romano -
2021 Poster: Conformal Prediction using Conditional Histograms »
Matteo Sesia · Yaniv Romano -
2020 Poster: Classification with Valid and Adaptive Coverage »
Yaniv Romano · Matteo Sesia · Emmanuel Candes -
2020 Spotlight: Classification with Valid and Adaptive Coverage »
Yaniv Romano · Matteo Sesia · Emmanuel Candes -
2019 Poster: Conformalized Quantile Regression »
Yaniv Romano · Evan Patterson · Emmanuel Candes -
2019 Poster: Conformal Prediction Under Covariate Shift »
Ryan Tibshirani · Rina Barber · Emmanuel Candes · Aaditya Ramdas -
2015 Poster: Solving Random Quadratic Systems of Equations Is Nearly as Easy as Solving Linear Systems »
Yuxin Chen · Emmanuel Candes -
2015 Oral: Solving Random Quadratic Systems of Equations Is Nearly as Easy as Solving Linear Systems »
Yuxin Chen · Emmanuel Candes -
2014 Poster: A Differential Equation for Modeling Nesterov’s Accelerated Gradient Method: Theory and Insights »
Weijie Su · Stephen Boyd · Emmanuel Candes -
2014 Spotlight: A Differential Equation for Modeling Nesterov’s Accelerated Gradient Method: Theory and Insights »
Weijie Su · Stephen Boyd · Emmanuel Candes