Spotlight
Volume Regularization for Binary Classification
Yacov Crammer · Tal Wagner

Tue Dec 4th 10:18 -- 10:22 AM @ Harveys Convention Center Floor, CC
We introduce a large-volume box classification for binary prediction, which maintains a subset of weight vectors, and specifically axis-aligned boxes. Our learning algorithm seeks for a box of large volume that contains ``simple'' weight vectors which most of are accurate on the training set. Two versions of the learning process are cast as convex optimization problems, and it is shown how to solve them efficiently. The formulation yields a natural PAC-Bayesian performance bound and it is shown to minimize a quantity directly aligned with it. The algorithm outperforms SVM and the recently proposed AROW algorithm on a majority of $30$ NLP datasets and binarized USPS optical character recognition datasets.

Author Information

Yacov Crammer (Technion)
Tal Wagner (MIT)

More from the Same Authors