Skip to yearly menu bar Skip to main content


Poster

Understanding the Eluder Dimension

Gene Li · Pritish Kamath · Dylan J Foster · Nati Srebro

Hall J (level 1) #443

Keywords: [ Reinforcement Learning ] [ eluder dimension ]


Abstract: We provide new insights on eluder dimension, a complexity measure that has been extensively used to bound the regret of algorithms for online bandits and reinforcement learning with function approximation. First, we study the relationship between the eluder dimension for a function class and a generalized notion of \emph{rank}, defined for any monotone activation'' σ:RRσ:RR, which corresponds to the minimal dimension required to represent the class as a generalized linear model. It is known that when σσ has derivatives bounded away from 00, σσ-rank gives rise to an upper bound on eluder dimension for any function class; we show however that eluder dimension can be exponentially smaller than σσ-rank. We also show that the condition on the derivative is necessary; namely, when σσ is the relurelu activation, the eluder dimension can be exponentially larger than σσ-rank. For Boolean-valued function classes, we obtain a characterization of the eluder dimension in terms of star number and threshold dimension, quantities which are relevant in active learning and online learning respectively.

Chat is not available.