Timezone: »

 
Spotlight
RAAM: The Benefits of Robustness in Approximating Aggregated MDPs in Reinforcement Learning
Marek Petrik · Dharmashankar Subramanian

Wed Dec 10 12:30 PM -- 12:50 PM (PST) @ Level 2, room 210
in Spotlight Session 7: Reinforcement learning spotlights »

We describe how to use robust Markov decision processes for value function approximation with state aggregation. The robustness serves to reduce the sensitivity to the approximation error of sub-optimal policies in comparison to classical methods such as fitted value iteration. This results in reducing the bounds on the gamma-discounted infinite horizon performance loss by a factor of 1/(1-gamma) while preserving polynomial-time computational complexity. Our experimental results show that using the robust representation can significantly improve the solution quality with minimal additional computational cost.

Author Information

Marek Petrik (University of New Hampshire)
Dharmashankar Subramanian (IBM Research)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors