Interactive and Explainable Human-Centered AutoML

ERC (European Research Council)HORIZON-ERCID: 101041029
EC Contribution
€14,598
Consortium Size
1 orgs
Start Year
2022
Summary

Trust and interactivity are key factors in the future development and use of automated machine learning (AutoML), supporting developers and researchers in determining powerful task-specific machine learning pipelines, including pre-processing, predictive algorithm, their hyperparameters and--if applicable--the architecture design of deep neural networks. Although AutoML is ready for its prime time after it achieved impressive results in several machine learning (ML) applications and its efficiency improved by several orders of magnitudes in recent years, democratization of machine learning via AutoML is still not achieved. In contrast to previously purely automation-centered approaches, ixAutoML is designed with human users at its heart in several stages. First of all, the foundation of trustful use of AutoML will be based on explanations of its results and processes. Therefore, we aim for:1. Explaining static effects of design decisions in ML pipelines optimized by state-of-the-art AutoML systems.2. Explaining dynamic AutoML policies for temporal aspects of dynamically adapted hyperparameters while ML models are trained.These explanations will be the base for allowing interactions, bringing the best of two worlds together: human intuition and generalization capabilities for complex systems, and efficiency of systematic optimization approaches for AutoML. Concretely, we aim for:3. Enabling interactions between humans and AutoML by taking human's latent knowledge into account and learning when to interact.4. Building first ixAutoML prototypes and showing its efficiency in the context of Industry 4.0.Perfectly aligned with the EU's AI strategy and recent efforts on interpretability in the ML community, we strongly believe that this timely human-centered ixAutoML will have a substantial impact on the democratization of machine learning.

Consortium (1)

Project Results (14)

Source: CORDIS, the EU research results database.

Publications (13)
AMLTK: A Modular AutoML Toolkit in Python
Journal of Open Source Software· 2024DOI
Edward Bergman, Matthias Feurer, Aron Bahram, Amir Rezaei Balef, Lennart Purucker, Sarah Segel, Marius Lindauer, Frank Hutter, Katharina Eggensperger
Interactive Hyperparameter Optimization in Multi-Objective Problems via Preference Learning
Proceedings of the AAAI Conference on Artificial Intelligence· 2024DOI
Joseph Giovanelli, Alexander Tornede, Tanja Tornede, Marius Lindauer
Position Paper: A Call to Action for a Human-Centered AutoML Paradigm
International Conference on Machine Learning (ICML)· 2024
Marius Lindauer, Florian Karl, Anne Klier, Julia Moosbauer, Alexander Tornede, Andreas C Mueller, Frank Hutter, Matthias Feurer, Bernd Bischl
Application of machine learning for fleet-based condition monitoring of ball screw drives in machine tools
The International Journal of Advanced Manufacturing Technology· 2023DOI
Berend Denkena; Marc-André Dittrich; Hendrik Noske; Dirk Lange; Carolin Benjamins; Marius Lindauer
Automated Machine Learning for Remaining Useful Life Predictions
2023 IEEE International Conference on Systems, Man, and Cybernetics (SMC)· 2023DOI
Zöller, Marc-André; Mauthe, Fabian; Zeiler, Peter; Lindauer, Marius; Huber, Marco F.
AutoML in the Age of Large Language Models: Current Challenges, Future Opportunities and Risks
Transactions of Machine Learning Research (TMLR)· 2023DOI
Alexander Tornede; Difan Deng; Theresa Eimer; Joseph Giovanelli; Aditya Mohan; Tim Ruhkopf; Sarah Segel; Daphne Theodorakopoulos; Tanja Tornede; Henning Wachsmuth; Marius Lindauer
AutoRL Hyperparameter Landscapes
International Conference on AutoML· 2023DOI
Mohan, Aditya; Benjamins, Carolin; Wienecke, Konrad; Dockhorn, Alexander; Lindauer, Marius
Hyperparameters in Reinforcement Learning and How To Tune Them
International Conference on Machine Learning· 2023DOI
Eimer, Theresa; Lindauer, Marius; Raileanu, Roberta
PriorBand: Practical Hyperparameter Optimization in the Age of Deep Learning
37th Conference on Neural Information Processing Systems (NeurIPS 2023)· 2023DOI
Mallik, Neeratyoy; Bergman, Edward; Hvarfner, Carl; Stoll, Danny; Janowski, Maciej; Lindauer, Marius; Nardi, Luigi; Hutter, Frank
Symbolic Explanations for Hyperparameter Optimization
International Conference on AutoML· 2023DOI
Segel, Sarah; Graf, Helena; Tornede, Alexander; Bischl, Bernd; Lindauer, Marius
piBO: Augmenting Acquisition Functions with User Beliefs for Bayesian Optimization
ICLR 2022 Conference· 2022
Carl Hvarfner, Danny Stoll, Artur Souza, Marius Lindauer, Frank Hutter, Luigi Nardi
Practitioner Motives to Select Hyperparameter Optimization Methods
ArXiv· 2022DOI
Hasebrook, Niklas; Morsbach, Felix; Kannengießer, Niclas; Zöller, Marc; Franke, Jörg; Lindauer, Marius; Hutter, Frank; Sunyaev, Ali
PriorBand: HyperBand + Human Expert Knowledge
2022 NeurIPS Workshop on Meta Learning (MetaLearn)· 2022
Neeratyoy Mallik, Carl Hvarfner, Danny Stoll, Maciej Janowski, Eddie Bergman, Marius Lindauer, Luigi Nardi, Frank Hutter
Deliverables (1)
Documents, reports