Poster
First- and Second-Order Bounds for Adversarial Linear Contextual Bandits
Julia Olkhovskaya · Jack Mayo · Tim van Erven · Gergely Neu · Chen-Yu Wei
Great Hall & Hall B1+B2 (level 1) #1805
Abstract:
We consider the adversarial linear contextual bandit setting, whichallows for the loss functions associated with each of arms to changeover time without restriction. Assuming the -dimensional contexts aredrawn from a fixed known distribution, the worst-case expected regretover the course of rounds is known to scale as . Under the additional assumption that the density of the contextsis log-concave, we obtain a second-order bound of order in terms of the cumulative second moment of thelearner's losses , and a closely related first-order bound of order in terms of the cumulative loss of the bestpolicy . Since or may be significantly smaller than, these improve over the worst-case regret whenever the environmentis relatively benign. Our results are obtained using a truncated versionof the continuous exponential weights algorithm over the probabilitysimplex, which we analyse by exploiting a novel connection to the linearbandit setting without contexts.
Chat is not available.