Timezone: »

DUOL: A Double Updating Approach for Online Learning
Peilin Zhao · Steven Chu-Hong Hoi · Rong Jin

Mon Dec 07 07:00 PM -- 11:59 PM (PST) @

In most online learning algorithms, the weights assigned to the misclassified examples (or support vectors) remain unchanged during the entire learning process. This is clearly insufficient since when a new misclassified example is added to the pool of support vectors, we generally expect it to affect the weights for the existing support vectors. In this paper, we propose a new online learning method, termed "Double Updating Online Learning", or "DUOL" for short. Instead of only assigning a fixed weight to the misclassified example received in current trial, the proposed online learning algorithm also tries to update the weight for one of the existing support vectors. We show that the mistake bound can be significantly improved by the proposed online learning method. Encouraging experimental results show that the proposed technique is in general considerably more effective than the state-of-the-art online learning algorithms.

Author Information

Peilin Zhao (Nanyang Technological University)
Steven Chu-Hong Hoi (Nanyang Technological University)
Rong Jin (Michigan State University (MSU))

More from the Same Authors