Timezone: »

 
Spotlight
A Transductive Bound for the Voted Classifier with an Application to Semi-supervised Learning
Massih R Amini · Nicolas Usunier · Francois Laviolette

Tue Dec 09 05:20 PM -- 05:21 PM (PST) @
in Spotlights »

In this paper we present two transductive bounds on the risk of the majority vote estimated over partially labeled training sets. Our first bound is tight when the additional unlabeled training data are used in the cases where the voted classifier makes its errors on low margin observations and where the errors of the associated Gibbs classifier can accurately be estimated. In semi-supervised learning, considering the margin as an indicator of confidence constitutes the working hypothesis of algorithms which search the decision boundary on low density regions. In this case, we propose a second bound on the joint probability that the voted classifier makes an error over an example having its margin over a fixed threshold. As an application we are interested on self-learning algorithms which assign iteratively pseudo-labels to unlabeled training examples having margin above a threshold obtained from this bound. Empirical results on different datasets show the effectiveness of our approach compared to the same algorithm and the TSVM in which the threshold is fixed manually.

Author Information

Massih R Amini (University Joseph Fourier)
Nicolas Usunier (Université Pierre et Marie Curie)
Francois Laviolette (Université Laval)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors