Timezone: »

PALMER: Perception - Action Loop with Memory for Long-Horizon Planning
Onur Beker · Mohammad Mohammadi · Amir Zamir

Tue Nov 29 02:00 PM -- 04:00 PM (PST) @ Hall J #612

To achieve autonomy in a priori unknown real-world scenarios, agents should be able to: i) act from high-dimensional sensory observations (e.g., images), ii) learn from past experience to adapt and improve, and iii) be capable of long horizon planning. Classical planning algorithms (e.g. PRM, RRT) are proficient at handling long-horizon planning. Deep learning based methods in turn can provide the necessary representations to address the others, by modeling statistical contingencies between observations. In this direction, we introduce a general-purpose planning algorithm called PALMER that combines classical sampling-based planning algorithms with learning-based perceptual representations. For training these perceptual representations, we combine Q-learning with contrastive representation learning to create a latent space where the distance between the embeddings of two states captures how easily an optimal policy can traverse between them. For planning with these perceptual representations, we re-purpose classical sampling-based planning algorithms to retrieve previously observed trajectory segments from a replay buffer and restitch them into approximately optimal paths that connect any given pair of start and goal states. This creates a tight feedback loop between representation learning, memory, reinforcement learning, and sampling-based planning. The end result is an experiential framework for long-horizon planning that is significantly more robust and sample efficient compared to existing methods.

Author Information

Onur Beker (EPFL)
Mohammad Mohammadi (Sharif University of Technology)
Amir Zamir (Swiss Federal Institute of Technology (EPFL))

More from the Same Authors

  • 2023 Poster: 4M: Massively Multimodal Masked Modeling »
    David Mizrahi · Roman Bachmann · Oguzhan Kar · Teresa Yeo · Mingfei Gao · Afshin Dehghan · Amir Zamir
  • 2022 Spotlight: Lightning Talks 1B-4 »
    Andrei Atanov · Shiqi Yang · Wanshan Li · Yongchang Hao · Ziquan Liu · Jiaxin Shi · Anton Plaksin · Jiaxiang Chen · Ziqi Pan · yaxing wang · Yuxin Liu · Stepan Martyanov · Alessandro Rinaldo · Yuhao Zhou · Li Niu · Qingyuan Yang · Andrei Filatov · Yi Xu · Liqing Zhang · Lili Mou · Ruomin Huang · Teresa Yeo · kai wang · Daren Wang · Jessica Hwang · Yuanhong Xu · Qi Qian · Hu Ding · Michalis Titsias · Shangling Jui · Ajay Sohmshetty · Lester Mackey · Joost van de Weijer · Hao Li · Amir Zamir · Xiangyang Ji · Antoni Chan · Rong Jin
  • 2022 Spotlight: Task Discovery: Finding the Tasks that Neural Networks Generalize on »
    Andrei Atanov · Andrei Filatov · Teresa Yeo · Ajay Sohmshetty · Amir Zamir
  • 2022 Poster: Task Discovery: Finding the Tasks that Neural Networks Generalize on »
    Andrei Atanov · Andrei Filatov · Teresa Yeo · Ajay Sohmshetty · Amir Zamir