Timezone: »

 
Neural Solvers for Fast and Accurate Numerical Optimal Control
Federico Berto · Stefano Massaroli · Michael Poli · Jinkyoo Park

Tue Dec 14 11:30 AM -- 12:15 PM (PST) @
in The Symbiosis of Deep Learning and Differential Equations »
Event URL: https://openreview.net/forum?id=rwMWDGOjaQF »

Synthesizing optimal controllers for dynamical systems in practice involves solving real-time optimization problems with hard time constraints. These constraints restrict the class of numerical methods that can be applied; indeed, computationally expensive but accurate numerical routines often have to be replaced with fast and inaccurate methods, trading inference time for worse theoretical guarantees on solution accuracy. This paper proposes a novel methodology to accelerate numerical optimization of optimal control policies via hypersolvers, hybrids of a base solver and a neural network. In particular, we apply low–order explicit numerical methods for the ordinary differential equation (ODE) associated to the numerical optimal control problem, augmented with an additional parametric approximator trained to reduce local truncation errors introduced by the base solver. Given a target system to control, we first pre-train hypersolvers to approximate base solver residuals by sampling plausible control inputs. Then, we use the trained hypersolver to obtain fast and accurate solutions of the target system during optimization of the controller. The performance of our approach is evaluated in direct and model predictive optimal control settings, where we show consistent Pareto improvements in terms of solution accuracy and control performance.

Author Information

Federico Berto (Korea Advanced Institute of Science and Technology)
Stefano Massaroli (The University of Tokyo)
Michael Poli (Stanford University)

My work spans topics in deep learning, dynamical systems, variational inference and numerical methods. I am broadly interested in ensuring the successes achieved by deep learning methods in computer vision and natural language are extended to other engineering domains.

Jinkyoo Park (KAIST)

More from the Same Authors