Timezone: »

 
Workshop
Gaze meets ML
Ismini Lourentzou · Joy T Wu · Satyananda Kashyap · Alexandros Karargyris · Leo Anthony Celi · Ban Kawas · Sachin S Talathi

Sat Dec 03 05:30 AM -- 03:00 PM (PST) @ Room 386
Event URL: https://gaze-meets-ml.github.io/ »

Eye gaze has proven to be a cost-efficient way to collect large-scale physiological data that can reveal the underlying human attentional patterns in real-life workflows, and thus has long been explored as a signal to directly measure human-related cognition in various domains. Physiological data (including but not limited to eye gaze) offer new perception capabilities, which could be used in several ML domains, e.g., egocentric perception, embodied AI, NLP, etc. They can help infer human perception, intentions, beliefs, goals, and other cognition properties that are much needed for human-AI interactions and agent coordination. In addition, large collections of eye-tracking data have enabled data-driven modeling of human visual attention mechanisms, both for saliency or scanpath prediction, with twofold advantages: from the neuroscientific perspective to understand biological mechanisms better, and from the AI perspective to equip agents with the ability to mimic or predict human behavior and improve interpretability and interactions.

With the emergence of immersive technologies, now more than any time there is a need for experts of various backgrounds (e.g., machine learning, vision, and neuroscience communities) to share expertise and contribute to a deeper understanding of the intricacies of cost-efficient human supervision signals (e.g., eye-gaze) and their utilization towards by bridging human cognition and AI in machine learning research and development. The goal of this workshop is to bring together an active research community to collectively drive progress in defining and addressing core problems in gaze-assisted machine learning.

Author Information

Ismini Lourentzou (Virginia Tech)
Joy T Wu (Almaden Research Center, International Business Machines)
Satyananda Kashyap (IBM Research)

Satyananda Kashyap's research focuses on developing novel machine learning techniques to tackle problems in healthcare. Before joining IBM Research, he pursued his Ph.D. at the University of Iowa. At Iowa, his work focused on developing novel graph-based machine learning algorithms on longitudinal Knee MRIs to quantify and understand the degeneration of the knee joint with the progression of osteoarthritis. Currently, his research focuses on the problem of chest x-ray specifically on developing explainable AI methods for classifying the various diseases so that the machine diagnosis can be understood by a human and trusted.

Alexandros Karargyris (IHU Strasbourg)

Alex Karargyris is a research manager with a background in Medical Imaging and Machine Learning. He has worked for the US National Institutes of Health, IBM Research and other academic organizations with publications and workshops in leading venues such as Nature. He co-founded the Medical Accuracy group at MLCommons, a tech-industry supported group to build best practices for medical machine learning through scientific benchmarking.

Leo Anthony Celi (Massachusetts Institute of Technology)
Ban Kawas (Meta AI)
Sachin S Talathi (Qualcomm Inc)

More from the Same Authors

  • 2021 : Chest ImaGenome Dataset for Clinical Reasoning »
    Joy T Wu · Nkechinyere Agu · Ismini Lourentzou · Arjun Sharma · Joseph Alexander Paguio · Jasper Seth Yao · Edward C Dee · William Mitchell · Satyananda Kashyap · Andrea Giovannini · Leo Anthony Celi · Mehdi Moradi
  • 2022 : Metrics Reloaded »
    Annika Reinke · Lena Maier-Hein · Patrick Scholz · Minu D. Tizabi · Evangelia Christodoulou · Ben Glocker · Fabian Isensee · Jens Kleesiek · Michal Kozubek · Mauricio Reyes · Michael A. Riegler · Manuel Wiesenfarth · Michael Baumgartner · Matthias Eisenmann · Doreen Heckmann-Nötzel · A. Kavur · Tim Rädsch · Laura Acion · Michela Antonelli · Tal Arbel · Spyridon Bakas · Pete Bankhead · Arriel Benis · Florian Buettner · M. Jorge Cardoso · Veronika Cheplygina · Beth Cimini · Gary Collins · Keyvan Farahani · Luciana Ferrer · Adrian Galdran · Bram van Ginneken · Robert Haase · Daniel Hashimoto · Michael Hoffman · Merel Huisman · Pierre Jannin · Charles Kahn · Dagmar Kainmueller · Alexandros Karargyris · Bernhard Kainz · Alan Karthikesalingam · Hannes Kenngott · Florian Kofler · Annette Kopp-Schneider · Anna Kreshuk · Tahsin Kurc · Bennett Landman · Geert Litjens · Amin Madani · Klaus H. Maier-Hein · Anne Martel · Peter Mattson · Erik Meijering · Bjoern Menze · David Moher · Karel G.M. Moons · Henning Mueller · Brennan Nichyporuk · Felix Nickel · Jens Petersen · Nasir Rajpoot · Nicola Rieke · Julio Saez-Rodriguez · Clarisa Sanchez · Shravya Shetty · Maarten van Smeden · Carole Sudre · Ronald Summers · Abdel Aziz Taha · Sotirios Tsaftaris · Ben Ben Van Calster · Gaël Varoquaux · Paul Jäger
  • 2022 : SecNet: Semantic Eye Completion in Implicit Field »
    Yida Wang · Yiru Shen · David Joseph Tan · Federico Tombari · Sachin S Talathi
  • 2022 : SecNet: Semantic Eye Completion in Implicit Field »
    Yida Wang · Yiru Shen · David Joseph Tan · Federico Tombari · Sachin S Talathi
  • 2021 : Chest ImaGenome Dataset for Clinical Reasoning »
    Joy T Wu · Nkechinyere Agu · Ismini Lourentzou · Arjun Sharma · Joseph Alexander Paguio · Jasper Seth Yao · Edward C Dee · William Mitchell · Satyananda Kashyap · Andrea Giovannini · Leo Anthony Celi · Mehdi Moradi
  • 2020 Poster: Expert-Supervised Reinforcement Learning for Offline Policy Learning and Evaluation »
    Aaron Sonabend · Junwei Lu · Leo Anthony Celi · Tianxi Cai · Peter Szolovits
  • 2017 : Poster spotlights »
    Hiroshi Kuwajima · Masayuki Tanaka · Qingkai Liang · Matthieu Komorowski · Fanyu Que · Thalita F Drumond · Aniruddh Raghu · Leo Anthony Celi · Christina Göpfert · Andrew Ross · Sarah Tan · Rich Caruana · Yin Lou · Devinder Kumar · Graham Taylor · Forough Poursabzi-Sangdeh · Jennifer Wortman Vaughan · Hanna Wallach
  • 2016 : Opening Keynote by Leo Anthony Celi: Data-Driven Healthcare »
    Leo Anthony Celi