Workshop
Challenges in Deploying and Monitoring Machine Learning Systems
Alessandra Tosi 路 Andrei Paleyes 路 Christian Cabrera 路 Fariba Yousefi 路 S Roberts
Virtual
Fri 9 Dec, 1 a.m. PST
The goal of this event is to bring together people from different communities with the common interest in the Deployment of Machine Learning Systems.
With the dramatic rise of companies dedicated to providing Machine Learning software-as-a-service tools, Machine Learning has become a tool for solving real world problems that is increasingly more accessible in many industrial and social sectors. With the growth in number of deployments, also grows the number of known challenges and hurdles that practitioners face along the deployment process to ensure the continual delivery of good performance from deployed Machine Learning systems. Such challenges can lie in adoption of ML algorithms to concrete use cases, discovery and quality of data, maintenance of production ML systems, as well as ethics.
Schedule
Fri 1:00 a.m. - 1:05 a.m.
|
Opening Remarks
(
Introduction
)
>
SlidesLive Video |
Alessandra Tosi 路 Andrei Paleyes 馃敆 |
Fri 1:05 a.m. - 1:25 a.m.
|
Lessons from the deployment of data science during the COVID-19 response in Africa.
(
Invited talk
)
>
SlidesLive Video |
Morine Amutorine 馃敆 |
Fri 1:25 a.m. - 1:40 a.m.
|
Lessons from the deployment of data science during the COVID-19 response in Africa.
(
Q/A for Invited talk
)
>
|
Morine Amutorine 路 Alessandra Tosi 馃敆 |
Fri 1:40 a.m. - 2:20 a.m.
|
Taking federated analytics from theory to practice
(
Invited talk
)
>
SlidesLive Video |
Graham Cormode 馃敆 |
Fri 2:20 a.m. - 2:35 a.m.
|
Taking federated analytics from theory to practice
(
Q/A for Invited talk
)
>
|
Graham Cormode 路 Alessandra Tosi 馃敆 |
Fri 2:35 a.m. - 2:45 a.m.
|
Break
|
馃敆 |
Fri 2:55 a.m. - 3:08 a.m.
|
MLOps: Open Challenges from Hardware and Software Perspective in TinyML Devices
(
Poster
)
>
SlidesLive Video |
Seong Oun Hwang 馃敆 |
Fri 3:08 a.m. - 3:19 a.m.
|
Deploying Imitation Learning using VR Hand Tracking in Robot Manipulation Tasks
(
Poster
)
>
SlidesLive Video |
Jinchul Choi 路 Chanwon Park 路 JUN HEE PARK 馃敆 |
Fri 3:19 a.m. - 3:31 a.m.
|
MLOps for Compositional AI
(
Poster
)
>
SlidesLive Video |
Debmalya Biswas 馃敆 |
Fri 3:31 a.m. - 3:44 a.m.
|
Tree DNN: A Deep Container Network
(
Poster
)
>
SlidesLive Video |
Brijraj Singh 路 Swati Gupta 路 Mayukh Das 路 Praveen Doreswamy Naidu 路 Sharan Allur 馃敆 |
Fri 3:50 a.m. - 4:30 a.m.
|
A Case for Rejection in Low Resource ML Deployment
(
Poster
)
>
|
Jerome White 路 Jigar Doshi 路 Pulkit Madaan 路 Nikhil Shenoy 路 Apoorv Agnihotri 路 Makkunda Sharma 馃敆 |
Fri 3:50 a.m. - 4:30 a.m.
|
Post-Training Neural Network Compression With Variational Bayesian Quantization
(
Poster
)
>
|
Zipei Tan 路 Robert Bamler 馃敆 |
Fri 3:50 a.m. - 4:30 a.m.
|
Continual learning on deployment pipelines for Machine Learning Systems
(
Poster
)
>
|
Li Qiang 路 Chongyu Zhang 馃敆 |
Fri 3:50 a.m. - 4:30 a.m.
|
Desiderata for next generation of ML model serving
(
Poster
)
>
|
Sherif Akoush 路 Andrei Paleyes 路 Arnaud Van Looveren 路 Clive Cox 馃敆 |
Fri 4:30 a.m. - 5:48 a.m.
|
Break
|
馃敆 |
Fri 5:48 a.m. - 5:50 a.m.
|
Introduction to the second session
(
Introduction
)
>
|
Christian Cabrera 馃敆 |
Fri 5:50 a.m. - 6:25 a.m.
|
Reinforcement learning in large-scale heterogeneous dynamic systems
(
Invited talk
)
>
SlidesLive Video |
Ivana Dusparic 馃敆 |
Fri 6:25 a.m. - 6:37 a.m.
|
Reinforcement learning in large-scale heterogeneous dynamic systems
(
Q/A for Invited talk
)
>
|
Ivana Dusparic 馃敆 |
Fri 6:37 a.m. - 6:44 a.m.
|
Gumbel-Softmax Selective Networks
(
Contributed talk
)
>
SlidesLive Video |
Mahmoud Salem 路 路 Fred Tung 路 Gabriel Oliveira 馃敆 |
Fri 6:44 a.m. - 6:53 a.m.
|
A Preliminary Study of MLOps Practices in GitHub
(
Poster
)
>
SlidesLive Video |
Fabio Calefato 路 Filippo Lanubile 路 Luigi Quaranta 馃敆 |
Fri 6:53 a.m. - 6:55 a.m.
|
Introduction to the speaker
(
Introduction
)
>
|
Andrei Paleyes 馃敆 |
Fri 6:55 a.m. - 7:35 a.m.
|
Security in production machine learning systems
(
Invited talk
)
>
SlidesLive Video |
Alejandro Saucedo 馃敆 |
Fri 7:35 a.m. - 7:50 a.m.
|
Security in production machine learning systems
(
Q/A for Invited talk
)
>
|
Alejandro Saucedo 馃敆 |
Fri 7:50 a.m. - 8:00 a.m.
|
Break
|
馃敆 |
Fri 8:00 a.m. - 9:00 a.m.
|
Panel on Open Problems in Machine Learning Systems
(
Panel discussion
)
>
SlidesLive Video |
Ivana Dusparic 路 Stephen J Roberts 路 Morine Amutorine 路 Jerome White 路 Murtuza Shergadwala 馃敆 |
Fri 9:00 a.m. - 9:30 a.m.
|
A Human-Centric Take on Model Monitoring
(
Poster
)
>
SlidesLive Video |
Murtuza Shergadwala 路 Himabindu Lakkaraju 路 Krishnaram Kenthapadi 馃敆 |
Fri 9:00 a.m. - 9:30 a.m.
|
AutoSlicer: Scalable Automated Data Slicing for ML Model Analysis
(
Poster
)
>
SlidesLive Video |
Zifan Liu 路 Evan Rosen 路 Paul Suganthan 馃敆 |
Fri 9:00 a.m. - 9:30 a.m.
|
Gumbel-Softmax Selective Networks
(
Poster
)
>
|
Mahmoud Salem 路 路 Fred Tung 路 Gabriel Oliveira 馃敆 |
Fri 9:00 a.m. - 9:30 a.m.
|
Bandits for Online Calibration: An Application to Content Moderation on Social Media Platforms
(
Poster
)
>
SlidesLive Video |
20 presentersVashist Avadhanula 路 Omar Abdul Baki 路 Hamsa Bastani 路 Osbert Bastani 路 Caner Gocmen 路 Daniel Haimovich 路 Darren Hwang 路 Dmytro Karamshuk 路 Thomas Leeper 路 Jiayuan Ma 路 Gregory macnamara 路 Jake Mullet 路 Christopher Palow 路 Sung Park 路 Varun S Rajagopal 路 Kevin Schaeffer 路 Parikshit Shah 路 Deeksha Sinha 路 Nicolas Stier-Moses 路 Ben Xu |
Fri 9:00 a.m. - 9:30 a.m.
|
Just Following AI Orders: When Unbiased People Are Influenced By Biased AI
(
Poster
)
>
SlidesLive Video |
Hammaad Adam 路 Aparna Balagopalan 路 Emily Alsentzer 路 Fotini Christia 路 Marzyeh Ghassemi 馃敆 |
Fri 9:00 a.m. - 9:30 a.m.
|
Characterizing Anomalies with Explainable Classifiers
(
Poster
)
>
SlidesLive Video |
Naveen Durvasula 路 Valentine d Hauteville 路 Keegan Hines 路 John Dickerson 馃敆 |
Fri 9:00 a.m. - 9:30 a.m.
|
SEIFER: Scalable Edge Inference for Deep Neural Networks
(
Poster
)
>
SlidesLive Video |
Arjun Parthasarathy 路 Bhaskar Krishnamachari 馃敆 |
Fri 9:00 a.m. - 9:30 a.m.
|
Property-Driven Evaluation of RL-Controllers in Self-Driving Datacenters
(
Poster
)
>
|
Arnav Chakravarthy 路 Nina Narodytska 路 Asmitha Rathis 路 Marius Vilcu 路 Mahmood Sharif 路 Gagandeep Singh 馃敆 |
Fri 9:30 a.m. - 10:00 a.m.
|
Practical differential privacy
(
Invited talk
)
>
SlidesLive Video |
Yu-Xiang Wang 馃敆 |
Fri 10:00 a.m. - 10:15 a.m.
|
Practical differential privacy
(
Q/A for Invited talk
)
>
|
Yu-Xiang Wang 路 Fariba Yousefi 馃敆 |
Fri 10:15 a.m. - 11:15 a.m.
|
Panel on Privacy and Security in Machine Learning Systems
(
Panel discussion
)
>
SlidesLive Video |
Graham Cormode 路 Borja Balle 路 Yu-Xiang Wang 路 Alejandro Saucedo 路 Neil Lawrence 馃敆 |
-
|
AutoSlicer: Scalable Automated Data Slicing for ML Model Analysis
(
Contributed talk
)
>
|
Zifan Liu 路 Evan Rosen 路 Paul Suganthan 馃敆 |
-
|
Deploying Imitation Learning using VR Hand Tracking in Robot Manipulation Tasks
(
Contributed talk
)
>
|
Jinchul Choi 路 Chanwon Park 路 JUN HEE PARK 馃敆 |
-
|
Tree DNN: A Deep Container Network
(
Contributed talk
)
>
|
Brijraj Singh 路 Swati Gupta 路 Mayukh Das 路 Praveen Doreswamy Naidu 路 Sharan Allur 馃敆 |
-
|
Bandits for Online Calibration: An Application to Content Moderation on Social Media Platforms
(
Contributed talk
)
>
|
20 presentersVashist Avadhanula 路 Omar Abdul Baki 路 Hamsa Bastani 路 Osbert Bastani 路 Caner Gocmen 路 Daniel Haimovich 路 Darren Hwang 路 Dmytro Karamshuk 路 Thomas Leeper 路 Jiayuan Ma 路 Gregory macnamara 路 Jake Mullet 路 Christopher Palow 路 Sung Park 路 Varun S Rajagopal 路 Kevin Schaeffer 路 Parikshit Shah 路 Deeksha Sinha 路 Nicolas Stier-Moses 路 Ben Xu |
-
|
Post-Training Neural Network Compression With Variational Bayesian Quantization
(
Contributed talk
)
>
|
Zipei Tan 路 Robert Bamler 馃敆 |
-
|
MLOps for Compositional AI
(
Contributed talk
)
>
|
Debmalya Biswas 馃敆 |
-
|
A Preliminary Study of MLOps Practices in GitHub
(
Poster
)
>
|
馃敆 |