Timezone: »

 
A Human-Centric Take on Model Monitoring
Murtuza Shergadwala · Himabindu Lakkaraju · Krishnaram Kenthapadi

Fri Dec 09 09:00 AM -- 09:30 AM (PST) @
in Challenges in Deploying and Monitoring Machine Learning Systems »

Predictive models are increasingly used for consequential decisions in high-stakes domains such as healthcare, finance, and policy. It becomes critical to ensure that these models make accurate predictions, are robust to shifts in the data, do not rely on spurious features, and do not unduly discriminate against minority groups. To this end, several approaches spanning various areas such as explainability, fairness, and robustness have been proposed in recent literature. Such approaches need to be human-centered as they cater to the understanding of the models to their users. However, there is a research gap in understanding the human-centric needs and challenges of monitoring machine learning (ML) models once they are deployed. To fill this gap, we conducted an interview study with 13 practitioners who have experience at the intersection of deploying ML models and engaging with customers spanning domains such as financial services, healthcare, hiring, online retail, computational advertising, and conversational assistants. We identified various human-centric challenges and requirements for model monitoring in real-world applications. Specifically, we found the need and the challenge for the model monitoring systems to clarify the impact of the monitoring observations on outcomes. Further, such insights must be actionable, customizable for domain-specific use cases, and cognitively considerate to avoid information overload.

[ Poster]  [ Topia] 

Author Information

Murtuza Shergadwala (Fiddler AI)

I'm a data scientist focusing on ML model monitoring and fairness. I have an engineering design, human decision making, and human-centered design background. Curious about how humans understand so much from so little.

Himabindu Lakkaraju (Harvard)

Hima Lakkaraju is an Assistant Professor at Harvard University focusing on explainability, fairness, and robustness of machine learning models. She has also been working with various domain experts in criminal justice and healthcare to understand the real world implications of explainable and fair ML. Hima has recently been named one of the 35 innovators under 35 by MIT Tech Review, and has received best paper awards at SIAM International Conference on Data Mining (SDM) and INFORMS. She has given invited workshop talks at ICML, NeurIPS, AAAI, and CVPR, and her research has also been covered by various popular media outlets including the New York Times, MIT Tech Review, TIME, and Forbes. For more information, please visit: https://himalakkaraju.github.io/

Krishnaram Kenthapadi (Fiddler AI)

More from the Same Authors