Timezone: »
Poster
Convergence guarantees for kernel-based quadrature rules in misspecified settings
Motonobu Kanagawa · Bharath Sriperumbudur · Kenji Fukumizu
Kernel-based quadrature rules are becoming important in machine learning and statistics, as they achieve super-$¥sqrt{n}$ convergence rates in numerical integration, and thus provide alternatives to Monte Carlo integration in challenging settings where integrands are expensive to evaluate or where integrands are high dimensional. These rules are based on the assumption that the integrand has a certain degree of smoothness, which is expressed as that the integrand belongs to a certain reproducing kernel Hilbert space (RKHS). However, this assumption can be violated in practice (e.g., when the integrand is a black box function), and no general theory has been established for the convergence of kernel quadratures in such misspecified settings. Our contribution is in proving that kernel quadratures can be consistent even when the integrand does not belong to the assumed RKHS, i.e., when the integrand is less smooth than assumed. Specifically, we derive convergence rates that depend on the (unknown) lesser smoothness of the integrand, where the degree of smoothness is expressed via powers of RKHSs or via Sobolev spaces.
Author Information
Motonobu Kanagawa (The Institute of Statistical Mathematics)
Bharath Sriperumbudur (Penn State University)
Kenji Fukumizu (Institute of Statistical Mathematics / Preferred Networks / RIKEN AIP)
More from the Same Authors
-
2022 Poster: Invariance Learning based on Label Hierarchy »
Shoji Toyota · Kenji Fukumizu -
2022 Poster: Unsupervised Learning of Equivariant Structure from Sequences »
Takeru Miyato · Masanori Koyama · Kenji Fukumizu -
2020 Poster: Robust Persistence Diagrams using Reproducing Kernels »
Siddharth Vishwanath · Kenji Fukumizu · Satoshi Kuriki · Bharath Sriperumbudur -
2019 Poster: Semi-flat minima and saddle points by embedding neural networks to overparameterization »
Kenji Fukumizu · Shoichiro Yamaguchi · Yoh-ichi Mototake · Mirai Tanaka -
2019 Poster: Tree-Sliced Variants of Wasserstein Distances »
Tam Le · Makoto Yamada · Kenji Fukumizu · Marco Cuturi -
2018 Poster: Variational Learning on Aggregate Outputs with Gaussian Processes »
Ho Chung Law · Dino Sejdinovic · Ewan Cameron · Tim Lucas · Seth Flaxman · Katherine Battle · Kenji Fukumizu -
2017 : Learning on topological and geometrical structures of data. »
Kenji Fukumizu -
2017 Workshop: Learning on Distributions, Functions, Graphs and Groups »
Florence d'Alché-Buc · Krikamol Muandet · Bharath Sriperumbudur · Zoltán Szabó -
2017 Poster: A Linear-Time Kernel Goodness-of-Fit Test »
Wittawat Jitkrittum · Wenkai Xu · Zoltan Szabo · Kenji Fukumizu · Arthur Gretton -
2017 Oral: A Linear-Time Kernel Goodness-of-Fit Test »
Wittawat Jitkrittum · Wenkai Xu · Zoltan Szabo · Kenji Fukumizu · Arthur Gretton -
2017 Poster: Trimmed Density Ratio Estimation »
Song Liu · Akiko Takeda · Taiji Suzuki · Kenji Fukumizu -
2016 Workshop: Adaptive and Scalable Nonparametric Methods in Machine Learning »
Aaditya Ramdas · Arthur Gretton · Bharath Sriperumbudur · Han Liu · John Lafferty · Samory Kpotufe · Zoltán Szabó -
2016 Poster: Minimax Estimation of Maximum Mean Discrepancy with Radial Kernels »
Ilya Tolstikhin · Bharath Sriperumbudur · Bernhard Schölkopf -
2015 Poster: Optimal Rates for Random Fourier Features »
Bharath Sriperumbudur · Zoltan Szabo -
2015 Spotlight: Optimal Rates for Random Fourier Features »
Bharath Sriperumbudur · Zoltan Szabo -
2014 Workshop: Modern Nonparametrics 3: Automating the Learning Pipeline »
Eric Xing · Mladen Kolar · Arthur Gretton · Samory Kpotufe · Han Liu · Zoltán Szabó · Alan Yuille · Andrew G Wilson · Ryan Tibshirani · Sasha Rakhlin · Damian Kozbur · Bharath Sriperumbudur · David Lopez-Paz · Kirthevasan Kandasamy · Francesco Orabona · Andreas Damianou · Wacha Bounliphone · Yanshuai Cao · Arijit Das · Yingzhen Yang · Giulia DeSalvo · Dmitry Storcheus · Roberto Valerio -
2014 Poster: Kernel Mean Estimation via Spectral Filtering »
Krikamol Muandet · Bharath Sriperumbudur · Bernhard Schölkopf -
2012 Poster: Learning from Distributions via Support Measure Machines »
Krikamol Muandet · Kenji Fukumizu · Francesco Dinuzzo · Bernhard Schölkopf -
2012 Poster: Gradient-based kernel method for feature extraction and variable selection »
Kenji Fukumizu · Chenlei Leng -
2012 Spotlight: Learning from Distributions via Support Measure Machines »
Krikamol Muandet · Kenji Fukumizu · Francesco Dinuzzo · Bernhard Schölkopf -
2012 Poster: Optimal kernel choice for large-scale two-sample tests »
Arthur Gretton · Bharath Sriperumbudur · Dino Sejdinovic · Heiko Strathmann · Sivaraman Balakrishnan · Massimiliano Pontil · Kenji Fukumizu -
2011 Poster: Kernel Bayes' Rule »
Kenji Fukumizu · Le Song · Arthur Gretton -
2011 Poster: Learning in Hilbert vs. Banach Spaces: A Measure Embedding Viewpoint »
Bharath Sriperumbudur · Kenji Fukumizu · Gert Lanckriet -
2009 Poster: Kernel Choice and Classifiability for RKHS Embeddings of Probability Distributions »
Bharath Sriperumbudur · Kenji Fukumizu · Arthur Gretton · Gert Lanckriet · Bernhard Schölkopf -
2009 Oral: Kernel Choice and Classifiability for RKHS Embeddings of Probability Distributions »
Bharath Sriperumbudur · Kenji Fukumizu · Arthur Gretton · Gert Lanckriet · Bernhard Schölkopf -
2009 Poster: Graph Zeta Function in the Bethe Free Energy and Loopy Belief Propagation »
Yusuke Watanabe · Kenji Fukumizu -
2009 Poster: On the Convergence of the Concave-Convex Procedure »
Bharath Sriperumbudur · Gert Lanckriet -
2009 Spotlight: Graph Zeta Function in the Bethe Free Energy and Loopy Belief Propagation »
Yusuke Watanabe · Kenji Fukumizu -
2009 Poster: A Fast, Consistent Kernel Two-Sample Test »
Arthur Gretton · Kenji Fukumizu · Zaid Harchaoui · Bharath Sriperumbudur -
2009 Spotlight: A Fast, Consistent Kernel Two-Sample Test »
Arthur Gretton · Kenji Fukumizu · Zaid Harchaoui · Bharath Sriperumbudur -
2008 Poster: Characteristic Kernels on Groups and Semigroups »
Kenji Fukumizu · Bharath Sriperumbudur · Arthur Gretton · Bernhard Schölkopf -
2008 Oral: Characteristic Kernels on Groups and Semigroups »
Kenji Fukumizu · Bharath Sriperumbudur · Arthur Gretton · Bernhard Schölkopf -
2007 Workshop: Representations and Inference on Probability Distributions »
Kenji Fukumizu · Arthur Gretton · Alexander Smola -
2007 Spotlight: Kernel Measures of Conditional Dependence »
Kenji Fukumizu · Arthur Gretton · Xiaohai Sun · Bernhard Schölkopf -
2007 Poster: Kernel Measures of Conditional Dependence »
Kenji Fukumizu · Arthur Gretton · Xiaohai Sun · Bernhard Schölkopf -
2007 Spotlight: A Kernel Statistical Test of Independence »
Arthur Gretton · Kenji Fukumizu · Choon Hui Teo · Le Song · Bernhard Schölkopf · Alexander Smola -
2007 Poster: A Kernel Statistical Test of Independence »
Arthur Gretton · Kenji Fukumizu · Choon Hui Teo · Le Song · Bernhard Schölkopf · Alexander Smola -
2006 Poster: Kernels on Structured Objects Through Nested Histograms »
Marco Cuturi · Kenji Fukumizu