It takes two to tango: a synergistic approach to human-machine decision making

Digital, Industry & SpaceHORIZON-RIAID: 101120763
EC Contribution
€70,088
Consortium Size
24 orgs
Start Year
2023
Summary

Artificial Intelligence (AI) holds enormous potential for enhancing human decisions, improving cognitive overload and lowering bias in high-stakes scenarios. Adoption of AI-based support systems in such applications is however minimal, chiefly due to the difficulty of assessing their assumptions, limitations and intentions. In order to realise the promise of AI for individuals, society and economy, people should feel they can trust AIs in terms of reliability, capacity to understand the human’s needs, and guarantees that they are genuinely aiming at helping them. TANGO will develop the theoretical basis and computational framework for hybrid decision support systems (HDSS) in which humans and machines are aligned in terms of values and goals, know their respective strengths, and work together to reach an optimal decision. To this end, TANGO will develop: 1) A cognitive theory of mutual understanding and hybrid decision making, of intuitive vs deliberative approaches to decision making and of how they affect our trust in human and AI teammates. 2) Cognition-aware explainable AIs implementing synergistic human-machine interaction, enabling machines to determine what information a specific decision maker (e.g., layperson vs expert) needs, or does not need, to reach an informed decision. 3) A “Human-in-the-loop” co-evolution of human decision making and machine learning models building on bi-directional, explanation-augmented interlocution. The TANGO framework will be evaluated on four high impact use cases, namely supporting: i) women during pregnancy and postpartum, ii) surgical teams in intraoperative decision making, iii) loan officers and applicants in credit lending decision processes, and iv) public policy makers in designing incentives and allocating funds. Success in these case studies will establish TANGO as the framework of reference for developing a new generation of synergistic AI systems, and will strengthen the leadership of Europe in human-centric AI.

Consortium (24)

Project Results (55)

Source: CORDIS, the EU research results database.

Publications (46)
Ensemble Counterfactual Explanations for Churn Analysis
Lecture Notes in Computer Science, Discovery Science· 2025DOI
Samuele Tonati, Marzio Di Vece, Roberto Pellungrini, Fosca Giannotti
Explainable AI in Time-Sensitive Scenarios: Prefetched Offline Explanation Model
Lecture Notes in Computer Science, Discovery Science· 2025DOI
Fabio Michele Russo, Carlo Metta, Anna Monreale, Salvatore Rinzivillo, Fabio Pinelli
Fostering effective hybrid human-LLM reasoning and decision making
FRONTIERS IN ARTIFICIAL INTELLIGENCE· 2025DOI
Passerini, Andrea; Gema, Aryo; Minervini, Pasquale; Sayin, Burcu; Tentori, Katya
Logically Consistent Language Models via Neuro-Symbolic Integration
International Conference on Learning Representations (ICLR)· 2025
Diego Calanzone, Stefano Teso, Antonio Vergari
NeST: The neuro-symbolic transpiler
International Journal of Approximate Reasoning· 2025DOI
Viktor Pfanschilling, Hikaru Shindo, Devendra Singh Dhami, Kristian Kersting
One-Shot Clustering for Federated Learning
2024 IEEE International Conference on Big Data (BigData)· 2025DOI
Maciej Krzysztof Zuziak, Roberto Pellungrini, Salvatore Rinzivillo
Reconsidering Faithfulness in Regular, Self-Explainable and Domain Invariant GNNs
Proceedings of ICLR· 2025
Steve Azzolin, Antonio Longa, Stefano Teso, Andrea Passerini
A Frank System for Co-Evolutionary Hybrid Decision-Making
Lecture Notes in Computer Science, Advances in Intelligent Data Analysis XXII· 2024DOI
Federico Mazzoni, Riccardo Guidotti, Alessio Malizia
A Neuro-Symbolic Benchmark Suite for Concept Quality and Reasoning Shortcuts
Advances in Neural Information Processing Systems 37 (NeurIPS 2024)· 2024
Bortolotti, Samuele; Marconato, Emanuele; Carraro, Tommaso; Morettin, Paolo; van Krieken, Emile; Vergari, Antonio; Teso, Stefano; Passerini, Andrea
A Simple and Expressive Graph Neural Network Based Method for Structural Link Representation
Proceedings of the GRaM Workshop at ICML 2024· 2024
Veronica Lachi, Francesco Ferrini, Antonio Longa, Bruno Lepri, Andrea Passerini
AI alignment: Assessing the global impact of recommender systems
Futures· 2024DOI
Ljubisa Bojic
BEARS Make Neuro-Symbolic Models Aware of their Reasoning Shortcuts
Proceedings of UAI· 2024
Marconato, Emanuele; Bortolotti, Samuele; van Krieken, Emile; Vergari, Antonio; Passerini, Andrea; Teso, Stefano
Can LLMs Correct Physicians, Yet? Investigating Effective Interaction Methods in the Medical Domain
Proceedings of the 6th Clinical Natural Language Processing Workshop· 2024DOI
Burcu Sayin, Pasquale Minervini, Jacopo Staiano, Andrea Passerini
CERN for AI: a theoretical framework for autonomous simulation-based artificial intelligence testing and alignment
European Journal of Futures Research· 2024DOI
Ljubiša Bojić; Matteo Cinelli; Dubravko Ćulibrk; Boris Delibašić
Conversational technology and reactions to withheld information
PLOS ONE· 2024DOI
Nikolos Gurney, George Loewenstein, Nick Chater
Coordination in dynamic interactions by converging on tacitly agreed joint plans
· 2024DOI
Arthur Le Pargneux, Hossam Zeitoun, Emmanouil Konstantinidis, Nick Chater
Designing for situated AI-human decision making: Lessons learned from a primary care deployment
SYNERGY 2024 – Designing and Building Hybrid Human-AI Systems 2024· 2024
Ben Wilson, Darren Scott, Matt Roach, Emily Nielsen, Berndt Muller
Disagreement-based Active Learning for Robustness Against Subpopulation Shifts
Proceedings of the HLDM Workshop at ECML 2024· 2024
Yeat Jeng Ng, Viktoriia Sharmanska, Thomas Kehrenberg, Anastasia Pentina, Novi Quadrianto
Enhancing Privacy and Utility in Federated Learning: A Hybrid P2P and Server-Based Approach with Differential Privacy Protection
Proceedings of the 21st International Conference on Security and Cryptography· 2024DOI
Luca Corbucci, Anna Monreale, Roberto Pellungrini
Epistemic Interaction – Tuning Interfaces to Provide Information for AI Support
SYNERGY 2024 – Designing and Building Hybrid Human-AI Systems 2024· 2024
Alan Dix, Ben Wilson Matt Roach, Tommaso Turchi, Alessio Malizia
Explaining the Explainers in Graph Neural Networks: a Comparative Study
ACM Computing Surveys· 2024DOI
Antonio Longa, Steve Azzolin, Gabriele Santin, Giulia Cencetti, Pietro Lio, Bruno Lepri, Andrea Passerini
Fast, Interpretable, and Deterministic Time Series Classification With a Bag-of-Receptive-Fields
IEEE Access· 2024DOI
Francesco Spinnato, Riccardo Guidotti, Anna Monreale, Mirco Nanni
Generative Model for Decision Trees
Proceedings of the AAAI Conference on Artificial Intelligence· 2024DOI
Riccardo Guidotti; Anna Monreale; Mattia Setzu; Giulia Volpi
Interpretable and Fair Mechanisms for Abstaining Classifiers
Lecture Notes in Computer Science, Machine Learning and Knowledge Discovery in Databases. Research Track· 2024DOI
Daphne Lenders, Andrea Pugnana, Roberto Pellungrini, Toon Calders, Dino Pedreschi, Fosca Giannotti
Preference Elicitation in Interactive and User-centered Algorithmic Recourse: an Initial Exploration
Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization· 2024DOI
Seyedehdelaram Esfahani, Giovanni De Toni, Bruno Lepri, Andrea Passerini, Katya Tentori, Massimo Zancanaro
PUFFLE: Balancing Privacy, Utility, and Fairness in Federated Learning
Frontiers in Artificial Intelligence and Applications, ECAI 2024· 2024DOI
Luca Corbucci, Mikko A. Heikkilä, David Solans Noguero, Anna Monreale, Nicolas Kourtellis
Resource-rational contractualism: A triple theory of moral cognition
Behavioral and Brain Sciences· 2024DOI
Sydney Levine, Nick Chater, Joshua B. Tenenbaum, Fiery Cushman
Rethinking and Recomputing the Value of Machine Learning Models
Crossref· 2024DOI
Burcu Sayin; Jie Yang; Xinyue Chen; Andrea Passerini; Fabio Casati
Sheaf Diffusion Goes Nonlinear: Enhancing GNNs with Adaptive Sheaf Laplacians
Proceedings of the GRaM Workshop at ICML 2024· 2024
Olga Zaghen, Antonio Longa, Steve Azzolin, Lev Telyatnikov, Andrea Passerini, Pietro Lio
Towards Logically Consistent Language Models via Probabilistic Reasoning
· 2024DOI
Calanzone, Diego; Teso, Stefano; Vergari, Antonio
Uncertainty Matters: Stable Conclusions Under Unstable Assessment of Fairness Results
Proceedings of the 27th International Conference on Artificial Intelligence and Statistics (AISTATS) 2024, Valencia, Spain. PMLR.· 2024
Ainhize Barrainkua, Paula Gordaliza, Jose A Lozano, Novi Quadrianto
Unveiling LLMs: The Evolution of Latent Representations in a Dynamic Knowledge Graph
Proceedings of COLM, 2024· 2024
Marco Bronzini, Carlo Nicolini, Bruno Lepri, Jacopo Staiano, Andrea Passerini
When rules are over-ruled: Virtual bargaining as a contractualist method of moral judgment
Cognition· 2024DOI
Sydney Levine, Max Kleiman-Weiner, Nick Chater, Fiery Cushman, Joshua B. Tenenbaum
Beyond the Face: Biometrics and Society
· 2023DOI
Bojan, Perkov; Jelena, Adamović; Duje, Kozomara; Mila, Bajić; Duje, Prkut
A Causal Framework for Evaluating Deferring Systems
Filippo Palomba, Andrea Pugnana, Jose Manuel Alvarez, Salvatore Ruggieri
Bongard in Wonderland: Visual Puzzles that Still Make AI Go Mad?
Proceedings of Sys2-Reasoning Workshop @ NeurIPS 2024
Antonia Wüst, Tim Tobiasch, Lukas Helff, Devendra Singh Dhami, Constantin A. Rothkopf, Kristian Kersting
Do LLMs suffer from Multi-Party Hangover? A Diagnostic Approach to Addressee Recognition and Response Selection in Conversations
Proceedings of the 2024 Conference on Empirical Methods in Natural Language ProcessingDOI
Nicolò Penzo, Maryam Sajedinia, Bruno Lepri, Sara Tonelli, and Marco Guerini
GLOR-FLEX: Local to Global Rule-Based EXplanations for Federated Learning
2024 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE)DOI
Rami Haffar; Francesca Naretto; David Sánchez; Anna Monreale; Josep Domingo-Ferrer
Interpretable Concept Bottlenecks to Align Reinforcement Learning Agents
Advances in Neural Information Processing, 2024
Quentin Delfosse, Sebastian Sztwiertnia, Mark Rothermel, Wolfgang Stammer, Kristian Kersting
L2loRe: a method for explaining the reject option
Clara Punzi, Roberto Pellungrini, Fosca Giannotti
Learning to Intervene on Concept Bottlenecks
Proceedings of ICML, 2024
David Steinmann, Wolfgang Stammer, Felix Friedrich, Kristian Kersting
Neural Concept Binder
Advances in Neural Information Processing, 2024
Wolfgang Stammer, Antonia Wüst, David Steinmann, Kristian Kersting
Pix2Code: Learning to Compose Neural Visual Concepts as Programs
Proceedings of UAI, 2024
Antonia Wüst, Wolfgang Stammer, Quentin Delfosse, Devendra Singh Dhami, Kristian Kersting
SMOSE: Sparse Mixture of Shallow Experts for Interpretable Reinforcement Learning in Continuous Control Tasks
Proceedings of AAAI 2025
Mátyás Vincze, Laura Ferrarotti, Leonardo Lucio Custode, Bruno Lepri, Giovanni Iacca
Systems with Switching Causal Relations: A Meta-Causal Perspective
Proceedings of CRL Workshop @ NeurIPS 2024
Moritz Willig, Tim Tobiasch, Florian Peter Busch, Jonas Seng, Devendra Singh Dhami, Kristian Kersting
Systems with Switching Causal Relations: A Meta-Causal Perspective
Proceedings of ICLR, 2025
Moritz Willig, Tim Tobiasch, Florian Peter Busch, Jonas Seng, Devendra Singh Dhami, Kristian Kersting
Deliverables (9)
Documents, reports
Websites, patent fillings, videos etc.
Data Management Plan
Documents, reports
Data Management Plan
Documents, reports