Timezone: »
Liquid state estimation is important for robotics tasks such as pouring; however, estimating the state of transparent liquids is a challenging problem. We propose a novel segmentation pipeline that can segment transparent liquids such as water from a static, RGB image without requiring any manual annotations or heating of the liquid for training. Instead, we use a generative model that is capable of translating unpaired images of colored liquids into synthetically generated transparent liquid images. Segmentation labels of colored liquids are obtained automatically using background subtraction. We use paired samples of synthetically generated transparent liquid images and background subtraction for our segmentation pipeline. Our experiments show that we are able to accurately predict a segmentation mask for transparent liquids without requiring any manual annotations. We demonstrate the utility of transparent liquid segmentation in a robotic pouring task that controls pouring by perceiving liquid height in a transparent cup. Accompanying video and supplementary information can be found at https://sites.google.com/view/roboticliquidpouring
Author Information
Gautham Narayan Narasimhan (Carnegie Mellon University)
Kai Zhang (University of Notre Dame)
Benjamin Eisner (Samsung AI Center - New York)
Xingyu Lin (Carnegie Mellon University)
David Held (CMU)
Related Events (a corresponding poster, oral, or spotlight)
-
2021 : Transparent Liquid Segmentation for Robotic Pouring »
Dates n/a. Room
More from the Same Authors
-
2021 : RB2: Robotic Manipulation Benchmarking with a Twist »
Sudeep Dasari · Jianren Wang · Joyce Hong · Shikhar Bahl · Yixin Lin · Austin Wang · Abitha Thankaraj · Karanbir Chahal · Berk Calli · Saurabh Gupta · David Held · Lerrel Pinto · Deepak Pathak · Vikash Kumar · Abhinav Gupta -
2019 Poster: Adaptive Auxiliary Task Weighting for Reinforcement Learning »
Xingyu Lin · Harjatin Baweja · George Kantor · David Held