Timezone: »

 
Poster
Deep Imitation Learning for Bimanual Robotic Manipulation
Fan Xie · Alexander Chowdhury · M. Clara De Paolis Kaluza · Linfeng Zhao · Lawson Wong · Rose Yu

Wed Dec 09 09:00 AM -- 11:00 AM (PST) @ Poster Session 3 #961
in Poster Session 4 »

We present a deep imitation learning framework for robotic bimanual manipulation in a continuous state-action space. A core challenge is to generalize the manipulation skills to objects in different locations. We hypothesize that modeling the relational information in the environment can significantly improve generalization. To achieve this, we propose to (i) decompose the multi-modal dynamics into elemental movement primitives, (ii) parameterize each primitive using a recurrent graph neural network to capture interactions, and (iii) integrate a high-level planner that composes primitives sequentially and a low-level controller to combine primitive dynamics and inverse kinematics control. Our model is a deep, hierarchical, modular architecture. Compared to baselines, our model generalizes better and achieves higher success rates on several simulated bimanual robotic manipulation tasks. We open source the code for simulation, data, and models at: https://github.com/Rose-STL-Lab/HDR-IL.

Author Information

Fan Xie (Northeastern University)
Alexander Chowdhury (Northeastern University)
M. Clara De Paolis Kaluza (Northeastern University)
Linfeng Zhao (Northeastern University)
Lawson Wong (Northeastern University)
Rose Yu (University of California, San Diego)

More from the Same Authors