Timezone: »
We consider the problem of recovering a signal observed in Gaussian noise. If the set of signals is convex and compact, and can be specified beforehand, one can use classical linear estimators that achieve a risk within a constant factor of the minimax risk. However, when the set is unspecified, designing an estimator that is blind to the hidden structure of the signal remains a challenging problem. We propose a new family of estimators to recover signals observed in Gaussian noise. Instead of specifying the set where the signal lives, we assume the existence of a well-performing linear estimator. Proposed estimators enjoy exact oracle inequalities and can be efficiently computed through convex optimization. We present several numerical illustrations that show the potential of the approach.
Author Information
Dmitry Ostrovsky (Univ. Grenoble Alpes)
Zaid Harchaoui (NYU)
Anatoli Juditsky (UJF)
Arkadi S Nemirovski (Gerogia Institute of Technology)
More from the Same Authors
-
2021 : Discrete Schrödinger Bridges with Applications to Two-Sample Homogeneity Testing »
Zaid Harchaoui · Lang Liu · Soumik Pal -
2021 : Discrete Schrödinger Bridges with Applications to Two-Sample Homogeneity Testing »
Zaid Harchaoui · Lang Liu · Soumik Pal -
2021 : Discrete Schrödinger Bridges with Applications to Two-Sample Homogeneity Testing »
Zaid Harchaoui · Lang Liu · Soumik Pal -
2021 Poster: Stochastic optimization under time drift: iterate averaging, step-decay schedules, and high probability guarantees »
Joshua Cutler · Dmitriy Drusvyatskiy · Zaid Harchaoui -
2021 Poster: Divergence Frontiers for Generative Models: Sample Complexity, Quantization Effects, and Frontier Integrals »
Lang Liu · Krishna Pillutla · Sean Welleck · Sewoong Oh · Yejin Choi · Zaid Harchaoui -
2021 Poster: MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontiers »
Krishna Pillutla · Swabha Swayamdipta · Rowan Zellers · John Thickstun · Sean Welleck · Yejin Choi · Zaid Harchaoui -
2021 Oral: MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontiers »
Krishna Pillutla · Swabha Swayamdipta · Rowan Zellers · John Thickstun · Sean Welleck · Yejin Choi · Zaid Harchaoui -
2015 Poster: A Universal Catalyst for First-Order Optimization »
Hongzhou Lin · Julien Mairal · Zaid Harchaoui -
2015 Poster: Semi-Proximal Mirror-Prox for Nonsmooth Composite Minimization »
Niao He · Zaid Harchaoui -
2014 Workshop: OPT2014: Optimization for Machine Learning »
Zaid Harchaoui · Suvrit Sra · Alekh Agarwal · Martin Jaggi · Miro Dudik · Aaditya Ramdas · Jean Lasserre · Yoshua Bengio · Amir Beck -
2014 Poster: Convolutional Kernel Networks »
Julien Mairal · Piotr Koniusz · Zaid Harchaoui · Cordelia Schmid -
2014 Spotlight: Convolutional Kernel Networks »
Julien Mairal · Piotr Koniusz · Zaid Harchaoui · Cordelia Schmid -
2013 Workshop: Greedy Algorithms, Frank-Wolfe and Friends - A modern perspective »
Martin Jaggi · Zaid Harchaoui · Federico Pierucci -
2011 Poster: On the accuracy of l1-filtering of signals with block-sparse structure »
Anatoli Juditsky · Fatma Kilinc Karzan · Arkadi S Nemirovski · Boris T Polyak -
2011 Spotlight: On the accuracy of l1-filtering of signals with block-sparse structure »
Anatoli Juditsky · Fatma Kilinc Karzan · Arkadi S Nemirovski · Boris T Polyak -
2009 Workshop: Temporal Segmentation: Perspectives from Statistics, Machine Learning, and Signal Processing »
Stephane Canu · Olivier Cappé · Arthur Gretton · Zaid Harchaoui · Alain Rakotomamonjy · Jean-Philippe Vert -
2009 Poster: A Fast, Consistent Kernel Two-Sample Test »
Arthur Gretton · Kenji Fukumizu · Zaid Harchaoui · Bharath Sriperumbudur -
2009 Spotlight: A Fast, Consistent Kernel Two-Sample Test »
Arthur Gretton · Kenji Fukumizu · Zaid Harchaoui · Bharath Sriperumbudur -
2008 Poster: Kernel Change-point Analysis »
Zaid Harchaoui · Francis Bach · Eric Moulines -
2007 Poster: Testing for Homogeneity with Kernel Fisher Discriminant Analysis »
Zaid Harchaoui · Francis Bach · Moulines Eric -
2007 Poster: DIFFRAC: a discriminative and flexible framework for clustering »
Francis Bach · Zaid Harchaoui -
2007 Poster: Catching Change-points with Lasso »
Zaid Harchaoui · Céline Lévy-Leduc