Timezone: »
Automated machine learning (AutoML) can make data scientists more productive. But if machine learning is totally automated, that leaves no room for data scientists to apply their intuition. Hence, data scientists often prefer not total but gradual automation, where they control certain choices and AutoML explores the rest. Unfortunately, gradual AutoML is cumbersome with state-of-the-art tools, requiring large non-compositional code changes. More concise compositional code can be achieved with combinators, a powerful concept from functional programming. This paper introduces a small set of orthogonal combinators for composing machine-learning operators into pipelines. It describes a translation scheme from pipelines and associated hyperparameter schemas to search spaces for AutoML optimizers. On that foundation, this paper presents Lale, an open-source sklearn-compatible AutoML library, and evaluates it with a user study.
Author Information
Guillaume Baudart (École normale supérieure)
Martin Hirzel (IBM Research AI)
Kiran Kate (IBM Research)
Parikshit Ram (IBM Research AI)
Avi Shinnar (International Business Machines)
Jason Tsay (IBM Research AI)
More from the Same Authors
-
2021 : FLoRA: Single-shot Hyper-parameter Optimization for Federated Learning »
Yi Zhou · Parikshit Ram · Theodoros Salonidis · Nathalie Baracaldo · Horst Samulowitz · Heiko Ludwig -
2021 : RASL: Relational Algebra in Scikit-Learn Pipelines »
Kiran Kate · Avi Shinnar · Thanh Lam Hoang · Martin Hirzel -
2021 : Sign-MAML: Efficient Model-Agnostic Meta-Learning by SignSGD »
Chen Fan · Parikshit Ram · Sijia Liu -
2021 : Contributed Talk 6: FLoRA: Single-shot Hyper-parameter Optimization for Federated Learning »
Yi Zhou · Parikshit Ram · Theodoros Salonidis · Nathalie Baracaldo · Horst Samulowitz · Heiko Ludwig -
2021 : RASL: Relational Algebra in Scikit-Learn Pipelines »
Chirag Sahni · Kiran Kate · Avi Shinnar · Thanh Lam Hoang · Martin Hirzel -
2020 Expo Demonstration: Beyond AutoML: AI Automation & Scaling »
Lisa Amini · Nitin Gupta · Parikshit Ram · Kiran Kate · Bhanukiran Vinzamuri · Nathalie Baracaldo · Martin Korytak · Daniel K Weidele · Dakuo Wang -
2017 : Poster Session / Coffee Break »
Hongyu Ren · Sheng Lundquist · Steven Hickson · Abhimanyu Dubey · Saki Shinoda · Ana Marasović · Otilia Stretcu · Fitsum Reda · Vikas Raunak · Cicero dos Santos · Liane Canas · Jesus Mager Hois · Martin Hirzel