Workshop
Bayesian Optimization: Black-box Optimization and Beyond
Roberto Calandra · Bobak Shahriari · Javier Gonzalez · Frank Hutter · Ryan Adams

Sat Dec 10th 08:00 AM -- 06:30 PM @ Room 117
in Saturday Workshops »
Event URL: http://bayesopt.com/ »

Bayesian optimization has emerged as an exciting subfield of machine learning that is concerned with the global optimization of expensive, noisy, black-box functions using probabilistic methods. Systems implementing Bayesian optimization techniques have been successfully used to solve difficult problems in a diverse set of applications. Many recent advances in the methodologies and theory underlying Bayesian optimization have extended the framework to new applications and provided greater insights into the behaviour of these algorithms. Bayesian optimization is now increasingly being used in industrial settings, providing new and interesting challenges that require new algorithms and theoretical insights.
Classically, Bayesian optimization has been used purely for expensive single-objective black-box optimization. However, with the increased complexity of tasks and applications, this paradigm is proving to be too restricted. Hence, this year’s theme for the workshop will be “black-box optimization and beyond”. Among the recent trends that push beyond BO we can briefly enumerate:
- Adapting BO to not-so-expensive evaluations.
- “Open the black-box” and move away from viewing the model as a way of simply fitting a response surface, and towards modelling for the purpose of discovering and understanding the underlying process. For instance, this so-called grey-box modelling approach could be valuable in robotic applications for optimizing the controller, while simultaneously providing insight into the mechanical properties of the robotic system.
- “Meta-learning”, where a higher level of learning is used on top of BO in order to control the optimization process and make it more efficient. Examples of such meta-learning include learning curve prediction, Freeze-thaw Bayesian optimization, online batch selection, multi-task and multi-fidelity learning.
- Multi-objective optimization where not a single objective, but multiple conflicting objectives are considered (e.g., prediction accuracy vs training time).
The target audience for this workshop consists of both industrial and academic practitioners of Bayesian optimization as well as researchers working on theoretical and practical advances in probabilistic optimization. We expect that this pairing of theoretical and applied knowledge will lead to an interesting exchange of ideas and stimulate an open discussion about the long term goals and challenges of the Bayesian optimization community.
A further goal is to encourage collaboration between the diverse set of researchers involved in Bayesian optimization. This includes not only interchange between industrial and academic researchers, but also between the many different subfields of machine learning which make use of Bayesian optimization or its components. We are also reaching out to the wider optimization and engineering communities for involvement.

09:00 AM Introduction and opening remarks (Openings)
09:10 AM Invited Talk 1: Roman Garnett (Talk)
09:40 AM Contributed Talk 1: Learning Optimal Interventions (Talk) Jonas Mueller
09:55 AM Contributed Talk 2: Efficient nonmyopic active search (Talk)
10:10 AM Poster Spotlights 1 (Spotlight)
10:30 AM Coffe Break (Break)
11:00 AM Katharina Eggensperger - Benchmarking Beyond Branin (Talk)
11:30 AM Poster Spotlights 2 (Talk)
11:45 AM Poster Session 1 (Posters)
12:00 PM Lunch Break (Break)
02:00 PM Alex Wiltschko - Bayesian Optimization in the Wild (Talk)
02:30 PM Poster Session 2 (Posters)
03:00 PM Coffee Break (Break)
03:30 PM Poster Session 3 (Posters)
04:00 PM Marc Toussaint - Bayesian Optimization: Applications in Robotics and Better Hyperparameters (Talk) Marc Toussaint
04:30 PM Joshua Knowles - Multiobjective Bayesian Optimization (Talk)
05:00 PM Panel discussion — Black-box Optimization & Beyond (Discussion Panel)

Author Information

Roberto Calandra (UC Berkeley)
Bobak Shahriari (University of British Columbia)
Javier Gonzalez (Amazon)
Frank Hutter (University of Freiburg)

Frank Hutter is a Full Professor for Machine Learning at the Computer Science Department of the University of Freiburg (Germany), where he previously was an assistant professor 2013-2017. Before that, he was at the University of British Columbia (UBC) for eight years, for his PhD and postdoc. Frank's main research interests lie in machine learning, artificial intelligence and automated algorithm design. For his 2009 PhD thesis on algorithm configuration, he received the CAIAC doctoral dissertation award for the best thesis in AI in Canada that year, and with his coauthors, he received several best paper awards and prizes in international competitions on machine learning, SAT solving, and AI planning. Since 2016 he holds an ERC Starting Grant for a project on automating deep learning based on Bayesian optimization, Bayesian neural networks, and deep reinforcement learning.

Ryan Adams (Google Brain and Princeton University)

More from the Same Authors