Timezone: »
The deployment of learning algorithms on autonomous vehicles is expensive, slow, and potentially unsafe. We present the F1/10 platform, a low-cost open-source 1/10th scale racecar and validated simulator which enables safe and rapid experimentation suitable for laboratory research settings. The F1/10 environment and hardware offer an accessible way to validate reinforcement learning policies learned in simulation and on a real car via the same intuitive OpenAI Gym API. To this effect, we demonstrate two approaches based on reinforcement learning that enable the transfer of policies from simulation to a real life track. The first demonstration details the use of our modular photorealistic simulator to learn an end-to-end racing policy in a self-supervised manner. Here, we demonstrate the F1/10’s capability for distributed online learning by sending batches of ‘experiences’ (video streams, odometry, etc.) back to a server, which asynchronously trains on this data and updates the racecar’s network weights on the fly. We also show a way to take quasi-deterministic ‘steps’ and perform ‘resets’ on the real car, thereby more closely mimicking the Gym API standards. The second demonstration uses our lightweight physics simulator to perform a joint optimization over a parameterized description of the racing trajectory, planning algorithms, and car dynamics, resulting in performance which exceeds all other entries in real-life races.
Author Information
Matthew O'Kelly (University of Pennsylvania)
Dhruv Karthik (University of Pennsylvania)
Hongrui Zheng (University of Pennsylvania)
Joseph Auckley (University of Pennsylvania)
Siddharth Singh (University of Pennsylvania)
Shashank D Prasad (University of Pennsylvania)
masters student in Embedded Systems. Conducting research in computer vision and machine learning methods for F1/10 cars at MLAB UPENN
Kim Luong (University of Pennsylvania)
Matthew R Lebermann (University of Pennsylvania)
Rahul Mangharam (University of Pennsylvania)
More from the Same Authors
-
2020 : Paper 52: Distributionally Robust Online Adaptation via Offline Population Synthesis »
Aman Sinha · Matthew O'Kelly · Hongrui Zheng -
2020 Poster: Neural Bridge Sampling for Evaluating Safety-Critical Autonomous Systems »
Aman Sinha · Matthew O'Kelly · Russ Tedrake · John Duchi -
2018 Poster: Scalable End-to-End Autonomous Vehicle Testing via Rare-event Simulation »
Matthew O'Kelly · Aman Sinha · Hongseok Namkoong · Russ Tedrake · John Duchi