Timezone: »

Hierarchical Multitask Structured Output Learning for Large-scale Sequence Segmentation
Nico Goernitz · Christian Widmer · Georg Zeller · Andre Kahles · Soeren Sonnenburg · Gunnar Rätsch

Mon Dec 12 10:00 AM -- 02:59 PM (PST) @ None #None

We present a novel regularization-based Multitask Learning (MTL) formulation for Structured Output (SO) prediction for the case of hierarchical task relations. Structured output learning often results in difficult inference problems and requires large amounts of training data to obtain accurate models. We propose to use MTL to exploit information available for related structured output learning tasks by means of hierarchical regularization. Due to the combination of example sets, the cost of training models for structured output prediction can easily become infeasible for real world applications. We thus propose an efficient algorithm based on bundle methods to solve the optimization problems resulting from MTL structured output learning. We demonstrate the performance of our approach on gene finding problems from the application domain of computational biology. We show that 1) our proposed solver achieves much faster convergence than previous methods and 2) that the Hierarchical SO-MTL approach clearly outperforms considered non-MTL methods.

Author Information

Nico Goernitz (TU Berlin)
Christian Widmer (MSKCC)
Georg Zeller (EMBL)
Andre Kahles (FML of the MPS)
Soeren Sonnenburg (TomTom)
Gunnar Rätsch (ETH Zürich)

More from the Same Authors