Timezone: »

 
Lifting the veil on hyper-parameters for value-baseddeep reinforcement learning
João Madeira Araújo · Johan Obando Ceron · Pablo Samuel Castro

Tue Dec 07 11:16 AM -- 11:30 AM (PST) @
in LatinX in AI (LXAI) Research @ NeurIPS 2021 »

Successful applications of deep reinforcement learning (deep RL) combine algorithmic design and careful hyper-parameter selection. The former often comes from iterative improvements over existing algorithms, while the latter is either inherited from prior methods or tuned for the specific method being introduced. Although critical to a method’s performance, the effect of the various hyper-parameter choices are often overlooked in favour of algorithmic advances. In this paper, we perform an initial empirical investigation into a number of often-overlooked hyper-parameters for value-based deep RL agents, demonstrating their varying levels of importance. We conduct this study on a varied set of classic control environments which helps highlight the effect each environment has on an algorithm’s hyper-parameter sensitivity.

Author Information

João Madeira Araújo (University of São Paulo)
Johan Obando Ceron (Université de Montréal)
Pablo Samuel Castro (Google)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors