Timezone: »
Deep learning models have been very successful at performing medical imaging tasks such as segmentation or registration. However, training these models requires substantial amounts of labeled data, most often annotated manually. Segmenting new medical images to create labeled training data is a tedious and time-consuming process for human annotators, particularly for 3D modalities involving sets of images. Existing frameworks for interactive segmentation have focused on minimizing initial user interaction and training domain-specific models with limited generalizability. Most interactive segmentation systems have two stages: first, the user provides initial input to seed a rough predicted segmentation, and then they provide additional feedback to refine the segmentation over multiple iterations. When segmenting objects or modalities not seen in the training data, these systems may require the user to make many corrections to clarify their target if the initial predicted segmentation focuses on the wrong object or they wish to segment multiple noncontiguous objects. We propose a probabilistic interactive segmentation system to help human annotators quickly and accurately segment new medical images. At each iteration this system takes in an input image and the partial segmentation completed so far, and probabilistically predicts a next step for the segmentation i.e., a larger partial segmentation. We focus on predicting several possible segmentations, to enable the user to quickly choose the correct next step in ambiguous situations.
Author Information
Hallee Wong (MIT)
John Guttag (Massachusetts Institute of Technology)
Adrian Dalca (MIT, HMS)
More from the Same Authors
-
2020 : Learning MRI contrast agnostic registration »
Malte Hoffmann · Adrian Dalca -
2021 : Sequential Decision Making with Limited Resources »
Hallee Wong · Maggie Makar · Aniruddh Raghu · John Guttag -
2022 : Conditional Contrastive Networks »
Emily Mu · John Guttag -
2022 : UniverSeg: Universal Medical Image Segmentation »
Victor Butoi · Jose Javier Gonzalez Ortiz · Tianyu Ma · John Guttag · Mert Sabuncu · Adrian Dalca -
2022 : Probabilistic Interactive Segmentation for Medical Images »
Hallee Wong · John Guttag · Adrian Dalca -
2022 : Contrast Invariant Feature Representations for Medical Image Analysis »
Yue Zhi, Russ Chua · Adrian Dalca -
2022 : Region-of-Interest Adaptive Acquisition for Accelerated MRI »
Zihui Wu · Tianwei Yin · Adrian Dalca · Katherine Bouman -
2022 : At the Intersection of Conceptual Art and Deep Learning: The End of Signature »
Kathleen Lewis · Divya Shanmugam · Jose Javier Gonzalez Ortiz · Agnieszka Kurant · John Guttag -
2022 : Contrastive Learning of Electrodermal Activity Representations for Stress Detection »
Katie Matton · Robert Lewis · John Guttag · Rosalind Picard -
2022 : Contrastive Pre-Training for Multimodal Medical Time Series »
Aniruddh Raghu · Payal Chandak · Ridwan Alam · John Guttag · Collin Stultz -
2022 : Contrastive Pre-Training for Multimodal Medical Time Series »
Aniruddh Raghu · Payal Chandak · Ridwan Alam · John Guttag · Collin Stultz -
2019 Workshop: Machine Learning for Health (ML4H): What makes machine learning in medicine different? »
Andrew Beam · Tristan Naumann · Brett Beaulieu-Jones · Irene Y Chen · Madalina Fiterau · Samuel Finlayson · Emily Alsentzer · Adrian Dalca · Matthew McDermott -
2019 Poster: Learning Conditional Deformable Templates with Convolutional Networks »
Adrian Dalca · Marianne Rakic · John Guttag · Mert Sabuncu -
2018 : Poster session »
David Zeng · Marzieh S. Tahaei · Shuai Chen · Felix Meister · Meet Shah · Anant Gupta · Ajil Jalal · Eirini Arvaniti · David Zimmerer · Konstantinos Kamnitsas · Pedro Ballester · Nathaniel Braman · Udaya Kumar · Sil C. van de Leemput · Junaid Qadir · Hoel Kervadec · Mohamed Akrout · Adrian Tousignant · Matthew Ng · Raghav Mehta · Miguel Monteiro · Sumana Basu · Jonas Adler · Adrian Dalca · Jizong Peng · Sungyeob Han · Xiaoxiao Li · Karthik Gopinath · Joseph Cheng · Bogdan Georgescu · Kha Gia Quach · Karthik Sarma · David Van Veen -
2018 : Oral session II »
Sil C. van de Leemput · Adrian Dalca · Karthik Gopinath -
2018 : Poster Session I »
Aniruddh Raghu · Daniel Jarrett · Kathleen Lewis · Elias Chaibub Neto · Nicholas Mastronarde · Shazia Akbar · Chun-Hung Chao · Henghui Zhu · Seth Stafford · Luna Zhang · Jen-Tang Lu · Changhee Lee · Adityanarayanan Radhakrishnan · Fabian Falck · Liyue Shen · Daniel Neil · Yusuf Roohani · Aparna Balagopalan · Brett Marinelli · Hagai Rossman · Sven Giesselbach · Jose Javier Gonzalez Ortiz · Edward De Brouwer · Byung-Hoon Kim · Rafid Mahmood · Tzu Ming Hsu · Antonio Ribeiro · Rumi Chunara · Agni Orfanoudaki · Kristen Severson · Mingjie Mai · Sonali Parbhoo · Albert Haque · Viraj Prabhu · Di Jin · Alena Harley · Geoffroy Dubourg-Felonneau · Xiaodan Hu · Maithra Raghu · Jonathan Warrell · Nelson Johansen · Wenyuan Li · Marko Järvenpää · Satya Narayan Shukla · Sarah Tan · Vincent Fortuin · Beau Norgeot · Yi-Te Hsu · Joel H Saltz · Veronica Tozzo · Andrew Miller · Guillaume Ausset · Azin Asgarian · Francesco Paolo Casale · Antoine Neuraz · Bhanu Pratap Singh Rawat · Turgay Ayer · Xinyu Li · Mehul Motani · Nathaniel Braman · Laetitia M Shao · Adrian Dalca · Hyunkwang Lee · Emma Pierson · Sandesh Ghimire · Yuji Kawai · Owen Lahav · Anna Goldenberg · Denny Wu · Pavitra Krishnaswamy · Colin Pawlowski · Arijit Ukil · Yuhui Zhang -
2018 Workshop: Machine Learning for Health (ML4H): Moving beyond supervised learning in healthcare »
Andrew Beam · Tristan Naumann · Marzyeh Ghassemi · Matthew McDermott · Madalina Fiterau · Irene Y Chen · Brett Beaulieu-Jones · Michael Hughes · Farah Shamout · Corey Chivers · Jaz Kandola · Alexandre Yahi · Samuel Finlayson · Bruno Jedynak · Peter Schulam · Natalia Antropova · Jason Fries · Adrian Dalca · Irene Chen -
2018 Poster: Gaussian Process Prior Variational Autoencoders »
Francesco Paolo Casale · Adrian Dalca · Luca Saglietti · Jennifer Listgarten · Nicolo Fusi -
2017 Workshop: Machine Learning for Health (ML4H) - What Parts of Healthcare are Ripe for Disruption by Machine Learning Right Now? »
Jason Fries · Alex Wiltschko · Andrew Beam · Isaac S Kohane · Jasper Snoek · Peter Schulam · Madalina Fiterau · David Kale · Rajesh Ranganath · Bruno Jedynak · Michael Hughes · Tristan Naumann · Natalia Antropova · Adrian Dalca · SHUBHI ASTHANA · Prateek Tandon · Jaz Kandola · Uri Shalit · Marzyeh Ghassemi · Tim Althoff · Alexander Ratner · Jumana Dakka