Skip to yearly menu bar Skip to main content


Poster

Experimental Designs for Heteroskedastic Variance

Justin Weltz · Tanner Fiez · Alexander Volfovsky · Eric Laber · Blake Mason · houssam nassif · Lalit Jain

Great Hall & Hall B1+B2 (level 1) #920

Abstract: Most linear experimental design problems assume homogeneous variance, while the presence of heteroskedastic noise is present in many realistic settings. Let a learner have access to a finite set of measurement vectors XRd that can be probed to receive noisy linear responses of the form y=xθ+η. Here θRd is an unknown parameter vector, and η is independent mean-zero σx2-sub-Gaussian noise defined by a flexible heteroskedastic variance model, σx2=xΣx. Assuming that ΣRd×d is an unknown matrix, we propose, analyze and empirically evaluate a novel design for uniformly bounding estimation error of the variance parameters, σx2. We demonstrate this method on two adaptive experimental design problems under heteroskedastic noise, fixed confidence transductive best-arm identification and level-set identification and prove the first instance-dependent lower bounds in these settings.Lastly, we construct near-optimal algorithms and demonstrate the large improvements in sample complexity gained from accounting for heteroskedastic variance in these designs empirically.

Chat is not available.