Timezone: »
Multivariate loss functions are used to assess performance in many modern prediction tasks, including information retrieval and ranking applications. Convex approximations are typically optimized in their place to avoid NP-hard empirical risk minimization problems. We propose to approximate the training data instead of the loss function by posing multivariate prediction as an adversarial game between a loss-minimizing prediction player and a loss-maximizing evaluation player constrained to match specified properties of training data. This avoids the non-convexity of empirical risk minimization, but game sizes are exponential in the number of predicted variables. We overcome this intractability using the double oracle constraint generation method. We demonstrate the efficiency and predictive performance of our approach on tasks evaluated using the precision at k, the F-score and the discounted cumulative gain.
Author Information
Hong Wang (University of Illinois at Chic)
Wei Xing (University of Illinois at Chicago)
Kaiser Asif (University of Illinois at Chicago)
Brian Ziebart (University of Illinois at Chicago)
More from the Same Authors
-
2023 Poster: Distributionally Robust Skeleton Learning of Discrete Bayesian Networks »
Yeshu Li · Brian Ziebart -
2022 Poster: Moment Distributionally Robust Tree Structured Prediction »
Yeshu Li · Danyal Saeed · Xinhua Zhang · Brian Ziebart · Kevin Gimpel -
2021 : Fairness for Robust Learning to Rank »
Omid Memarrast · Ashkan Rezaei · Rizal Fathony · Brian Ziebart -
2018 Poster: Policy-Conditioned Uncertainty Sets for Robust Markov Decision Processes »
Andrea Tirinzoni · Marek Petrik · Xiangli Chen · Brian Ziebart -
2018 Spotlight: Policy-Conditioned Uncertainty Sets for Robust Markov Decision Processes »
Andrea Tirinzoni · Marek Petrik · Xiangli Chen · Brian Ziebart -
2018 Poster: Distributionally Robust Graphical Models »
Rizal Fathony · Ashkan Rezaei · Mohammad Ali Bashiri · Xinhua Zhang · Brian Ziebart -
2017 Poster: Adversarial Surrogate Losses for Ordinal Regression »
Rizal Fathony · Mohammad Ali Bashiri · Brian Ziebart -
2016 Poster: Adversarial Multiclass Classification: A Risk Minimization Perspective »
Rizal Fathony · Anqi Liu · Kaiser Asif · Brian Ziebart -
2015 Poster: Softstar: Heuristic-Guided Probabilistic Inference »
Mathew Monfort · Brenden M Lake · Brenden Lake · Brian Ziebart · Patrick Lucey · Josh Tenenbaum -
2014 Workshop: Novel Trends and Applications in Reinforcement Learning »
Csaba Szepesvari · Marc Deisenroth · Sergey Levine · Pedro Ortega · Brian Ziebart · Emma Brunskill · Naftali Tishby · Gerhard Neumann · Daniel Lee · Sridhar Mahadevan · Pieter Abbeel · David Silver · Vicenç Gómez -
2014 Poster: Robust Classification Under Sample Selection Bias »
Anqi Liu · Brian Ziebart -
2014 Spotlight: Robust Classification Under Sample Selection Bias »
Anqi Liu · Brian Ziebart