Timezone: »
There has been a recent burst in “AutoML” techniques as a means to automate the creation of ML models without necessary domain expertise. This demonstration looks well beyond AutoML’s current narrow focus on automated model building, to tackling automation across the full end-to-end AI/ML lifecycle. In industry settings, the AI/ML lifecycle typically includes a series of labor-intensive tasks such as preparing data, training models, deploying the selected model in cloud, monitoring performance, identifying faults, and taking corrective actions when failures or new business requirements occur. Enormous opportunities exist for scaling, automating, and accelerating this AI/ML lifecycle.
In this session, we demonstrate tools and research results in driving automation across the entire AI/ML lifecycle: from assessing data readiness and recommending mitigations, to semantically-driven automation based on concept discovery and knowledge augmentation, to advanced ML model building with business and fairness constraints, to novel pipelines for industry-critical modalities, to automation for monitoring models in deployment, recognizing deficiencies and recommending corrective actions. We will also demonstrate practical methods for scaling in multi-cloud environments with federated learning, and accelerated cloud-based inference of widely-popular classical ML algorithms such as XGBoost and LightGBM.
Author Information
Lisa Amini (IBM Research)
Nitin Gupta (IBM Research)
Parikshit Ram (IBM Research)
Kiran Kate (IBM Research)
Bhanukiran Vinzamuri (IBM Research)
Nathalie Baracaldo (IBM Research AI)
Nathalie Baracaldo leads the AI Security and Privacy Solutions team and is a Research Staff Member at IBM’s Almaden Research Center in San Jose, CA. Nathalie is passionate about delivering machine learning solutions that are highly accurate, withstand adversarial attacks and protect data privacy. Her team focuses on two main areas: federated learning, where models are trained without directly accessing training data and adversarial machine learning, where defenses are designed to withstand potential attacks to the machine learning pipeline. Nathalie is the primary investigator for the DARPA program Guaranteeing AI Robustness Against Deception (GARD), where AI security is investigated. Her team contributes to the Adversarial Robustness 360 Toolbox (ART). Nathalie is also the co-editor of the book: “Federated Learning: A Comprehensive Overview of Methods and Applications”, 2022 available in paper and as e-book in Springer, Apple books and Amazon. Nathalie's primary research interests lie at the intersection of information security, privacy and trust. As part of her work, she has also designed and implemented secure systems in the areas of cloud computing, Platform as a Service, secure data sharing and Internet of the Things. She has also contributed to projects to design scalable systems that monitor, manage performance and manage service level agreements in cloud environments. In 2020, Nathalie received the IBM Master Inventor distinction for her contributions to the IBM Intellectual Property and innovation. Nathalie also received the 2021 Corporate Technical Recognition, one of the highest recognitions provided to IBMers for breakthrough technical achievements that have led to notable market and industry success for IBM. This recognition was awarded for Nathalie's contribution to the Trusted AI initiative. Nathalie is associated Editor IEEE Transactions on Service Computing. Nathalie received her Ph.D. degree from the University of Pittsburgh in 2016. Her dissertation focused on preventing insider threats through the use of adaptive access control systems that integrate multiple sources of contextual information. Some of the topics that she has explored in the past include secure storage systems, privacy in online social networks, secure interoperability in distributed systems, risk management and trust evaluation. During her Ph.D. studies she received the 2014 Allen Kent Award for Outstanding Contributions to the Graduate Program in Information Science by the School of Information Sciences at the University of Pittsburgh. Nathalie also holds a master’s degree with Cum Laude distinction in computer sciences from the Universidad de los Andes, Colombia. Prior to that, she earned two undergraduate degrees in Computer Science and Industrial Engineering at the same university.
Martin Korytak (IBM Research)
Daniel K Weidele (IBM Research)
Dakuo Wang (IBM)
More from the Same Authors
-
2021 : FLoRA: Single-shot Hyper-parameter Optimization for Federated Learning »
Yi Zhou · Parikshit Ram · Theodoros Salonidis · Nathalie Baracaldo · Horst Samulowitz · Heiko Ludwig -
2021 : RASL: Relational Algebra in Scikit-Learn Pipelines »
Kiran Kate · Avi Shinnar · Thanh Lam Hoang · Martin Hirzel -
2021 : Sign-MAML: Efficient Model-Agnostic Meta-Learning by SignSGD »
Chen Fan · Parikshit Ram · Sijia Liu -
2022 : Benchmarking the Effect of Poisoning Defenses on the Security and Bias of the Final Model »
Nathalie Baracaldo · Kevin Eykholt · Farhan Ahmed · Yi Zhou · Shriti Priya · Taesung Lee · Swanand Kadhe · Yusong Tan · Sridevi Polavaram · Sterling Suggs -
2023 Poster: Model Sparsity Can Simplify Machine Unlearning »
jinghan jia · Jiancheng Liu · Parikshit Ram · Yuguang Yao · Gaowen Liu · Yang Liu · PRANAY SHARMA · Sijia Liu -
2023 Workshop: Associative Memory & Hopfield Networks in 2023 »
Parikshit Ram · Hilde Kuehne · Daniel Lee · Cengiz Pehlevan · Mohammed Zaki · Lenka Zdeborová -
2022 Workshop: Federated Learning: Recent Advances and New Challenges »
Shiqiang Wang · Nathalie Baracaldo · Olivia Choudhury · Gauri Joshi · Peter Richtarik · Praneeth Vepakomma · Han Yu -
2022 Poster: Advancing Model Pruning via Bi-level Optimization »
Yihua Zhang · Yuguang Yao · Parikshit Ram · Pu Zhao · Tianlong Chen · Mingyi Hong · Yanzhi Wang · Sijia Liu -
2022 Expo Demonstration: Practical Deployment of Secure Federated Learning: Challenges, Opportunities and Solutions »
Yi Zhou · Nathalie Baracaldo -
2021 : Contributed Talk 6: FLoRA: Single-shot Hyper-parameter Optimization for Federated Learning »
Yi Zhou · Parikshit Ram · Theodoros Salonidis · Nathalie Baracaldo · Horst Samulowitz · Heiko Ludwig -
2021 : RASL: Relational Algebra in Scikit-Learn Pipelines »
Chirag Sahni · Kiran Kate · Avi Shinnar · Thanh Lam Hoang · Martin Hirzel -
2021 Poster: Pipeline Combinators for Gradual AutoML »
Guillaume Baudart · Martin Hirzel · Kiran Kate · Parikshit Ram · Avi Shinnar · Jason Tsay -
2020 Workshop: Workshop on Dataset Curation and Security »
Nathalie Baracaldo · Yonatan Bisk · Avrim Blum · Michael Curry · John Dickerson · Micah Goldblum · Tom Goldstein · Bo Li · Avi Schwarzschild -
2020 Poster: Model Agnostic Multilevel Explanations »
Karthikeyan Natesan Ramamurthy · Bhanukiran Vinzamuri · Yunfeng Zhang · Amit Dhurandhar -
2020 Poster: Training Stronger Baselines for Learning to Optimize »
Tianlong Chen · Weiyi Zhang · Zhou Jingyang · Shiyu Chang · Sijia Liu · Lisa Amini · Zhangyang Wang -
2020 Spotlight: Training Stronger Baselines for Learning to Optimize »
Tianlong Chen · Weiyi Zhang · Zhou Jingyang · Shiyu Chang · Sijia Liu · Lisa Amini · Zhangyang Wang -
2020 : Spotlight on women at IBM Research »
Lisa Amini · Francesca Rossi · Celia Cintas · Payel Das -
2019 : Poster Session »
Nathalie Baracaldo · Seth Neel · Tuyen Le · Dan Philps · Suheng Tao · Sotirios Chatzis · Toyo Suzumura · Wei Wang · WENHANG BAO · Solon Barocas · Manish Raghavan · Samuel Maina · Reginald Bryant · Kush Varshney · Skyler D. Speakman · Navdeep Gill · Nicholas Schmidt · Kevin Compher · Naveen Sundar Govindarajulu · Vivek Sharma · Praneeth Vepakomma · Tristan Swedish · Jayashree Kalpathy-Cramer · Ramesh Raskar · Shihao Zheng · Mykola Pechenizkiy · Marco Schreyer · Li Ling · Chirag Nagpal · Robert Tillman · Manuela Veloso · Hanjie Chen · Xintong Wang · Michael Wellman · Matthew van Adelsberg · Ben Wood · Hans Buehler · Mahmoud Mahfouz · Antonios Alexos · Megan Shearer · Antigoni Polychroniadou · Lucia Larise Stavarache · Dmitry Efimov · Johnston P Hall · Yukun Zhang · Emily Diana · Sumitra Ganesh · Vineeth Ravi · · Swetasudha Panda · Xavier Renard · Matthew Jagielski · Yonadav Shavit · Joshua Williams · Haoran Wei · Shuang (Sophie) Zhai · Xinyi Li · Hongda Shen · Daiki Matsunaga · Jaesik Choi · Alexis Laignelet · Batuhan Guler · Jacobo Roa Vicens · Ajit Desai · Jonathan Aigrain · Robert Samoilescu -
2018 Poster: Zeroth-Order Stochastic Variance Reduction for Nonconvex Optimization »
Sijia Liu · Bhavya Kailkhura · Pin-Yu Chen · Paishun Ting · Shiyu Chang · Lisa Amini -
2018 Demonstration: Game for Detecting Backdoor Attacks on Deep Neural Networks using Activation Clustering »
Casey Dugan · Werner Geyer · Narendra Nath Joshi · Ingrid Lange · Dustin Ramsey Torres · Bryant Chen · Nathalie Baracaldo · Heiko Ludwig -
2017 Poster: Optimized Pre-Processing for Discrimination Prevention »
Flavio Calmon · Dennis Wei · Bhanukiran Vinzamuri · Karthikeyan Natesan Ramamurthy · Kush Varshney -
2013 Poster: Which Space Partitioning Tree to Use for Search? »
Parikshit Ram · Alexander Gray -
2009 Poster: Linear-time Algorithms for Pairwise Statistical Problems »
Parikshit Ram · Dongryeol Lee · William B March · Alexander Gray -
2009 Spotlight: Linear-time Algorithms for Pairwise Statistical Problems »
Parikshit Ram · Dongryeol Lee · William B March · Alexander Gray -
2009 Poster: Rank-Approximate Nearest Neighbor Search: Retaining Meaning and Speed in High Dimensions »
Parikshit Ram · Dongryeol Lee · Hua Ouyang · Alexander Gray