Timezone: »

 
Poster
Nonparametric von Mises Estimators for Entropies, Divergences and Mutual Informations
Kirthevasan Kandasamy · Akshay Krishnamurthy · Barnabas Poczos · Larry Wasserman · james m robins

Wed Dec 09 04:00 PM -- 08:59 PM (PST) @ 210 C #69
in Poster Session »

We propose and analyse estimators for statistical functionals of one or moredistributions under nonparametric assumptions.Our estimators are derived from the von Mises expansion andare based on the theory of influence functions, which appearin the semiparametric statistics literature.We show that estimators based either on data-splitting or a leave-one-out techniqueenjoy fast rates of convergence and other favorable theoretical properties.We apply this framework to derive estimators for several popular informationtheoretic quantities, and via empirical evaluation, show the advantage of thisapproach over existing estimators.

[ PDF] 

Author Information

Kirthevasan Kandasamy (CMU)
Akshay Krishnamurthy (CMU)
Barnabas Poczos (Carnegie Mellon University)
Larry Wasserman (Carnegie Mellon University)
james m robins (Harvard University)

More from the Same Authors