Timezone: »
Semantic cues and statistical regularities in real-world environment layouts can improve efficiency for navigation in novel environments. This paper learns and leverages such semantic cues for navigating to objects of interest in novel environments, by simply watching YouTube videos. This is challenging because YouTube videos don't come with labels for actions or goals, and may not even showcase optimal behavior. Our method tackles these challenges through the use of Q-learning on pseudo-labeled transition quadruples (image, action, next image, reward). We show that such off-policy Q-learning from passive data is able to learn meaningful semantic cues for navigation. These cues, when used in a hierarchical navigation policy, lead to improved efficiency at the ObjectGoal task in visually realistic simulations. We observe a relative improvement of 15-83% over end-to-end RL, behavior cloning, and classical methods, while using minimal direct interaction.
Author Information
Matthew Chang (University of Illinois Urbana-Champaign)
Arjun Gupta (University of Illinois at Urbana-Champaign)
Saurabh Gupta (UIUC)
More from the Same Authors
-
2021 : RB2: Robotic Manipulation Benchmarking with a Twist »
Sudeep Dasari · Jianren Wang · Joyce Hong · Shikhar Bahl · Yixin Lin · Austin Wang · Abitha Thankaraj · Karanbir Chahal · Berk Calli · Saurabh Gupta · David Held · Lerrel Pinto · Deepak Pathak · Vikash Kumar · Abhinav Gupta -
2021 : Learning Value Functions from Undirected State-only Experience »
Matthew Chang · Arjun Gupta · Saurabh Gupta -
2021 : Learning Value Functions from Undirected State-only Experience »
Matthew Chang · Arjun Gupta · Saurabh Gupta -
2022 : One-shot Visual Imitation via Attributed Waypoints and Demonstration Augmentation »
Matthew Chang · Saurabh Gupta -
2023 Poster: Look Ma, No Hands! Agent-Environment Factorization of Egocentric Videos »
Matthew Chang · Aditya Prakash · Saurabh Gupta -
2021 Poster: SEAL: Self-supervised Embodied Active Learning using Exploration and 3D Consistency »
Devendra Singh Chaplot · Murtaza Dalal · Saurabh Gupta · Jitendra Malik · Russ Salakhutdinov