Timezone: »
Learning a regression function using censored or interval-valued output data is an important problem in fields such as genomics and medicine. The goal is to learn a real-valued prediction function, and the training output labels indicate an interval of possible values. Whereas most existing algorithms for this task are linear models, in this paper we investigate learning nonlinear tree models. We propose to learn a tree by minimizing a margin-based discriminative objective function, and we provide a dynamic programming algorithm for computing the optimal solution in log-linear time. We show empirically that this algorithm achieves state-of-the-art speed and prediction accuracy in a benchmark of several data sets.
Author Information
Alexandre Drouin (Element AI)
Toby Hocking (McGill Genome Center, McGill University)
Francois Laviolette (Université Laval)
More from the Same Authors
-
2019 Poster: Dichotomize and Generalize: PAC-Bayesian Binary Activated Deep Neural Networks »
Gaël Letarte · Pascal Germain · Benjamin Guedj · Francois Laviolette -
2017 : Neil Lawrence, Francis Bach and François Laviolette »
Neil Lawrence · Francis Bach · Francois Laviolette -
2017 : François Laviolette - A Tutorial on PAC-Bayesian Theory »
Francois Laviolette -
2012 Workshop: Multi-Trade-offs in Machine Learning »
Yevgeny Seldin · Guy Lever · John Shawe-Taylor · Nicolò Cesa-Bianchi · Yacov Crammer · Francois Laviolette · Gabor Lugosi · Peter Bartlett -
2011 Workshop: New Frontiers in Model Order Selection »
Yevgeny Seldin · Yacov Crammer · Nicolò Cesa-Bianchi · Francois Laviolette · John Shawe-Taylor -
2011 Poster: PAC-Bayesian Analysis of Contextual Bandits »
Yevgeny Seldin · Peter Auer · Francois Laviolette · John Shawe-Taylor · Ronald Ortner -
2009 Poster: From PAC-Bayes Bounds to KL Regularization »
Pascal Germain · Alexandre Lacasse · Francois Laviolette · Mario Marchand · Sara Shanian -
2008 Poster: A Transductive Bound for the Voted Classifier with an Application to Semi-supervised Learning »
Massih R Amini · Nicolas Usunier · Francois Laviolette -
2008 Spotlight: A Transductive Bound for the Voted Classifier with an Application to Semi-supervised Learning »
Massih R Amini · Nicolas Usunier · Francois Laviolette -
2006 Poster: A PAC-Bayes Risk Bound for General Loss Functions »
Pascal Germain · Alexandre Lacasse · Francois Laviolette · Mario Marchand -
2006 Poster: PAC-Bayes Bounds for the Risk of the Majority Vote and the Variance of the Gibbs Classifier »
Alexandre Lacasse · Francois Laviolette · Mario Marchand · Pascal Germain · Nicolas Usunier -
2006 Spotlight: PAC-Bayes Bounds for the Risk of the Majority Vote and the Variance of the Gibbs Classifier »
Alexandre Lacasse · Francois Laviolette · Mario Marchand · Pascal Germain · Nicolas Usunier