Timezone: »

 
Poster
Fault-Tolerant Federated Reinforcement Learning with Theoretical Guarantee
Xiaofeng Fan · Yining Ma · Zhongxiang Dai · Wei Jing · Cheston Tan · Bryan Kian Hsiang Low

Wed Dec 08 04:30 PM -- 06:00 PM (PST) @ Virtual
in Poster Session 4 »

The growing literature of Federated Learning (FL) has recently inspired Federated Reinforcement Learning (FRL) to encourage multiple agents to federatively build a better decision-making policy without sharing raw trajectories. Despite its promising applications, existing works on FRL fail to I) provide theoretical analysis on its convergence, and II) account for random system failures and adversarial attacks. Towards this end, we propose the first FRL framework the convergence of which is guaranteed and tolerant to less than half of the participating agents being random system failures or adversarial attackers. We prove that the sample efficiency of the proposed framework is guaranteed to improve with the number of agents and is able to account for such potential failures or attacks. All theoretical results are empirically verified on various RL benchmark tasks.

Keywords: Optimization · Reinforcement Learning and Planning · Adversarial Robustness and Security · Federated Learning

Author Information

Xiaofeng Fan (National University of Singapore)
Yining Ma (National University of Singapore)
Zhongxiang Dai (National University of Singapore)
Wei Jing (Alibaba Group)
Cheston Tan (Institute for Infocomm Research, Singapore)
Bryan Kian Hsiang Low (National University of Singapore)

More from the Same Authors