Timezone: »
Semi-supervised learning seeks to learn a machine learning model when only a small amount of the available data is labeled. The most widespread approach uses a graph prior, which encourages similar instances to have similar predictions. This has been very successful with models ranging from kernel machines to neural networks, but has remained inapplicable to decision trees, for which the optimization problem is much harder. We solve this based on a reformulation of the problem which requires iteratively solving two simpler problems: a supervised tree learning problem, which can be solved by the Tree Alternating Optimization algorithm; and a label smoothing problem, which can be solved through a sparse linear system. The algorithm is scalable and highly effective even with very few labeled instances, and makes it possible to learn accurate, interpretable models based on decision trees in such situations.
Author Information
Arman Zharmagambetov (University of California, Merced)
Miguel A. Carreira-Perpinan (University of California, Merced)
More from the Same Authors
-
2018 Poster: Alternating optimization of decision trees, with application to learning sparse oblique trees »
Miguel A. Carreira-Perpinan · Pooya Tavallali -
2017 : Poster Session 2 »
Farhan Shafiq · Antonio Tomas Nevado Vilchez · Takato Yamada · Sakyasingha Dasgupta · Robin Geyer · Moin Nabi · Crefeda Rodrigues · Edoardo Manino · Alexantrou Serb · Miguel A. Carreira-Perpinan · Kar Wai Lim · Bryan Kian Hsiang Low · Rohit Pandey · Marie C White · Pavel Pidlypenskyi · Xue Wang · Christine Kaeser-Chen · Michael Zhu · Suyog Gupta · Sam Leroux -
2017 : Poster Session (encompasses coffee break) »
Beidi Chen · Borja Balle · Daniel Lee · iuri frosio · Jitendra Malik · Jan Kautz · Ke Li · Masashi Sugiyama · Miguel A. Carreira-Perpinan · Ramin Raziperchikolaei · Theja Tulabandhula · Yung-Kyun Noh · Adams Wei Yu -
2016 Poster: An ensemble diversity approach to supervised binary hashing »
Miguel A. Carreira-Perpinan · Ramin Raziperchikolaei -
2016 Poster: Optimizing affinity-based binary hashing using auxiliary coordinates »
Ramin Raziperchikolaei · Miguel A. Carreira-Perpinan -
2015 Poster: A fast, universal algorithm to learn parametric nonlinear embeddings »
Miguel A. Carreira-Perpinan · Max Vladymyrov -
2011 Poster: A Denoising View of Matrix Completion »
Weiran Wang · Miguel A. Carreira-Perpinan · Zhengdong Lu -
2007 Poster: People Tracking with the Laplacian Eigenmaps Latent Variable Model »
Zhengdong Lu · Miguel A. Carreira-Perpinan · Cristian Sminchisescu