Timezone: »
Uncertainty quantification is essential for a robot operating in an open world, not only for known concepts, but especially for unknown concepts that it may encounter and classify. In recent years, prototype-based approaches have shown to be an effective direction for classification in deep networks. In such approaches, each concept is represented by a single vector -- a prototype -- on the output manifold of the network. The starting point of this work is that common choices of prototype positions, whether it be one-hot vectors, vectors from prior knowledge, vectors from separation, or random vectors, are indeed effective for classification, but fail to quantify when a sample displays an unknown concept. The hypothesis of this work is that in order to best quantify uncertainty over known and unknown concepts, prototypes should be uniform and equidistant. We introduce Equidistant Hyperspherical Prototype Networks, where arbitrary numbers of concepts are modelled as equidistant prototypes on a hyperspherical output manifold. This results in a distribution of the output space with as much room as possible for unknown concepts to occupy the empty space between the prototypes. We provide initial empirical results on MIT Indoor Places which show that equidistant prototypes can both model known concepts and quantify when samples display unknown concepts. The equidistant prototypes are defined by recursion, easy to implement, and with trivial overhead in computation, making them suitable for open world settings.
Author Information
Gertjan Burghouts (TNO - Intelligent Imaging)
Pascal Mettes (University of Amsterdam)
More from the Same Authors
-
2022 : Self-Contained Entity Discovery from Captioned Videos »
melika ayoughi · Paul Groth · Pascal Mettes -
2022 : Hyperbolic Image Segmentation »
Mina Ghadimi Atigh · Julian Schoep · Erman Acar · Nanne van Noord · Pascal Mettes -
2022 : Maximum Class Separation as Inductive Bias in One Matrix »
Tejaswi Kasarla · Gertjan Burghouts · Max van Spengler · Elise van der Pol · Rita Cucchiara · Pascal Mettes -
2022 : Unlocking Slot Attention by Changing Optimal Transport Costs »
Yan Zhang · David Zhang · Simon Lacoste-Julien · Gertjan Burghouts · Cees Snoek -
2022 : Self-Guided Diffusion Model »
TAO HU · David Zhang · Yuki Asano · Gertjan Burghouts · Cees Snoek -
2022 : Unlocking Slot Attention by Changing Optimal Transport Costs »
Yan Zhang · David Zhang · Simon Lacoste-Julien · Gertjan Burghouts · Cees Snoek -
2022 : Unlocking Slot Attention by Changing Optimal Transport Costs »
Yan Zhang · David Zhang · Simon Lacoste-Julien · Gertjan Burghouts · Cees Snoek -
2022 Poster: Maximum Class Separation as Inductive Bias in One Matrix »
Tejaswi Kasarla · Gertjan Burghouts · Max van Spengler · Elise van der Pol · Rita Cucchiara · Pascal Mettes -
2021 Poster: Independent Prototype Propagation for Zero-Shot Compositionality »
Frank Ruis · Gertjan Burghouts · Doina Bucur -
2021 Poster: Hyperbolic Busemann Learning with Ideal Prototypes »
Mina Ghadimi Atigh · Martin Keller-Ressel · Pascal Mettes -
2019 Poster: Hyperspherical Prototype Networks »
Pascal Mettes · Elise van der Pol · Cees Snoek -
2007 Poster: The Distribution Family of Similarity Distances »
Gertjan Burghouts · Arnold Smeulders · Jan-Mark Geusebroek