Timezone: »
The ROC curve is known to be the golden standard for measuring performance of a test/scoring statistic regarding its capacity of discrimination between two populations in a wide variety of applications, ranging from anomaly detection in signal processing to information retrieval, through medical diagnosis. Most practical performance measures used in scoring applications such as the AUC, the local AUC, the p-norm push, the DCG and others, can be seen as summaries of the ROC curve. This paper highlights the fact that many of these empirical criteria can be expressed as (conditional) linear rank statistics. We investigate the properties of empirical maximizers of such performance criteria and provide preliminary results for the concentration properties of a novel class of random variables that we will call a linear rank process.
Author Information
Stephan Clémençon (Telecom ParisTech)
Nicolas Vayatis (Ecole Normale Supérieure de Cachan)
More from the Same Authors
-
2021 : Handling Distribution Shift in Tire Design »
Antoine De mathelin · François Deheeger · Mathilde MOUGEOT · Nicolas Vayatis -
2022 Poster: What are the best Systems? New Perspectives on NLP Benchmarking »
Pierre Colombo · Nathan Noiry · Ekhine Irurozki · Stephan Clémençon -
2018 Poster: On Binary Classification in Extreme Regions »
Hamid Jalalzai · Stephan Clémençon · Anne Sabourin -
2016 Poster: On Graph Reconstruction via Empirical Risk Minimization: Fast Learning Rates and Scalability »
Guillaume Papa · Aurélien Bellet · Stephan Clémençon -
2014 Poster: Tight Bounds for Influence in Diffusion Networks and Application to Bond Percolation and Epidemiology »
Remi Lemonnier · Kevin Scaman · Nicolas Vayatis -
2012 Poster: Link Prediction in Graphs with Autoregressive Features »
Emile Richard · Stephane Gaiffas · Nicolas Vayatis -
2010 Poster: Link Discovery using Graph Feature Tracking »
Emile Richard · Nicolas Baskiotis · Theos Evgeniou · Nicolas Vayatis -
2009 Poster: AUC optimization and the two-sample problem »
Stéphan Clémençon · Nicolas Vayatis · Marine Depecker -
2008 Poster: On Bootstrapping the ROC Curve »
Patrice Bertail · Stephan Clémençon · Nicolas Vayatis -
2008 Poster: Overlaying classifiers: a practical approach for optimal ranking »
Stephan Clémençon · Nicolas Vayatis