Timezone: »
General policy mapping: online continual reinforcement learning inspired on the insect brain
Angel Yanguas-Gil · Sandeep Madireddy
Event URL: https://openreview.net/forum?id=G7IUNe224F »
We have developed a model for online continual reinforcement learning (RL) inspired on the insect brain. Our model leverages the offline training of a feature extraction and a common general policy layer to enable the convergence of RL algorithms in online settings. Sharing a common policy layer across tasks leads to positive backward transfer, where the agent continuously improved in older tasks sharing the same underlying general policy. Biologically inspired restrictions to the agent's network are key for the convergence of RL algorithms. This provides a pathway towards efficient online RL in resource-constrained scenarios.
Author Information
Angel Yanguas-Gil (Argonne National Laboratory)
Sandeep Madireddy (Argonne National Laboratory)
More from the Same Authors
-
2021 : Physical Benchmarking for AI-generated Cosmic Web »
Xiaofeng Dong · Salman Habib · Sandeep Madireddy -
2021 : Robustness of deep learning algorithms in astronomy - galaxy morphology studies »
Aleksandra Ciprijanovic · Diana Kafkes · Gabriel Nathan Perdue · Sandeep Madireddy · Stefan Wild · Brian Nord -
2022 : Semi-Supervised Domain Adaptation for Cross-Survey Galaxy Morphology Classification and Anomaly Detection »
Aleksandra Ciprijanovic · Ashia Lewis · Kevin Pedro · Sandeep Madireddy · Brian Nord · Gabriel Nathan Perdue · Stefan Wild -
2022 : Towards Continually Learning Application Performance Models »
Ray Sinurat · Sandeep Madireddy · Anurag Daram · Haryadi Gunawi · Robert Ross -
2022 : Unified Probabilistic Neural Architecture and Weight Ensembling Improves Model Robustness »
Sumegha Premchandar · Sanket Jantre · Prasanna Balaprakash · Sandeep Madireddy -
2022 : Experimental platform and digital twin for AI-driven materials optimization and discovery for microelectronics using atomic layer deposition »
Angel Yanguas-Gil · Steve Letourneau · Noah Paulson · Jeffrey Elam