Timezone: »
Clustering is often formulated as the maximum likelihood estimation of a mixture model that explains the data. The EM algorithm widely used to solve the resulting optimization problem is inherently a gradient-descent method and is sensitive to initialization. The resulting solution is a local optimum in the neighborhood of the initial guess. This sensitivity to initialization presents a significant challenge in clustering large data sets into many clusters. In this paper, we present a different approach to approximate mixture fitting for clustering. We introduce an exemplar-based likelihood function that approximates the exact likelihood. This formulation leads to a convex minimization problem and an efficient algorithm with \emph{guaranteed convergence to the globally optimal solution}. The resulting clustering can be thought of as a probabilistic mapping of the data points to the set of exemplars that minimizes the average distance and the information-theoretic cost of mapping. We present experimental results illustrating the performance of our algorithm and its comparison with the conventional approach to mixture model clustering.
Author Information
Danial Lashkari (Massachusetts Institute of Technology)
Polina Golland (Massachusetts Institute of Technology)
Related Events (a corresponding poster, oral, or spotlight)
-
2007 Poster: Convex Clustering with Exemplar-Based Models »
Mon. Dec 3rd 06:30 -- 06:40 PM Room
More from the Same Authors
-
2021 : Bayesian Image Reconstruction using Deep Generative Models »
Razvan Marinescu · Daniel Moyer · Polina Golland -
2021 : Bayesian Image Reconstruction using Deep Generative Models »
Razvan Marinescu · Daniel Moyer · Polina Golland -
2020 Poster: PEP: Parameter Ensembling by Perturbation »
Alireza Mehrtash · Purang Abolmaesumi · Polina Golland · Tina Kapur · Demian Wassermann · William Wells -
2010 Spotlight: Functional Geometry Alignment and Localization of Brain Areas »
Georg Langs · Yanmei Tie · Laura Rigolo · Alexandra Golby · Polina Golland -
2010 Poster: Functional Geometry Alignment and Localization of Brain Areas »
Georg Langs · Yanmei Tie · Laura Rigolo · Alexandra Golby · Polina Golland -
2010 Poster: Categories and Functional Units: An Infinite Hierarchical Model for Brain Activations »
Danial Lashkari · Ramesh Sridharan · Polina Golland