ASSESSMENT AND ENGINEERING OF EQUITABLE, UNBIASED, IMPARTIAL AND TRUSTWORTHY AI SYSTEMS

Digital, Industry & SpaceHORIZON-RIAID: 101070363
EC Contribution
€34,940
Consortium Size
19 orgs
Start Year
2022
Summary

AI-based decision support systems are increasingly deployed in industry, in the public and private sectors, and in policy-making. As our society is facing a dramatic increase in inequalities and intersectional discrimination, we need to prevent AI systems to amplify this phenomenon but rather mitigate it. To trust these systems, domain experts and stakeholders need to trust the decisions.Fairness stands as one of the main principles of Trustworthy AI promoted at EU level. How these principles, in particular fairness, translate into technical, functional social, and lawful requirements in the AI system design is still an open question. Similarly we don’t know how to test if a system is compliant with these principles and repair it in case it is not.AEQUITAS proposes the design of a controlled experimentation environment for developers and users to create controlled experiments for- assessing the bias in AI systems, e.g., identifying potential causes of bias in data, algorithms, and interpretation of results,- providing, when possible, effective methods and engineering guidelines to repair, remove, and mitigate bias,- provide fairness-by-design guidelines, methodologies, and software engineering techniques to design new bias-free systemsThe experimentation environment generates synthetic data sets with different features influencing fairness for a test in laboratories. Real use cases in health care, human resources and social disadvantaged group challenges further test the experimentation platform showcasing the effectiveness of the solution proposed. The experimentation playground will be integrated on the AI-on-demand platform to boost its uptake, but a stand-alone release will enable on-premise privacy-preserving test of AI-systems fairness.AEQUITAS relies on a strong consortium featuring AI experts, domain experts in the use case sectors as well as social scientists and associations defending rights of minorities and discriminated groups.

Consortium (19)

Project Results (62)

Source: CORDIS, the EU research results database.

Publications (30)
AI Fairness Compliance: Operationalizing the Integration of Social and Legal Perspectives into AI Fairness Metrics
Frontiers in Artificial Intelligence and Applications, ECAI 2025· 2025DOI
Roberta Calegari
AI-fairness: The FairBridge Approach to Practically Bridge the Gap Between Socio-legal and Technical Perspectives
Proceedings of the Annual Hawaii International Conference on System Sciences, Proceedings of the 57th Hawaii International Conference on System Sciences· 2025DOI
Andrea Borghesi, Giovanni Ciatto, Mattia Matteini, Roberta Calegari, Laura Sartori, Maria Rebrean, Catelijne Muller
AI-fairness and equality of opportunity: a case study on educational achievement
· 2024
Marrero A. S.; Marrero G. A.; Bethencourt C.; James L.; Calegari R.
Enforcing Fairness via Constraint Injection with FaUCI
· 2024
Matteo Magnini; Giovanni Ciatto; Roberta Calegari; Andrea Omicini
Ensuring Fairness Stability for Disentangling Social Inequality in Access to Education: the FAiRDAS General Method
· 2024DOI
Eleonora Misino; Roberta Calegari; Michele Lombardi; Michela Milano
Generation of Clinical Skin Images with Pathology with Scarce Data
Studies in Computational Intelligence, AI for Health Equity and Fairness· 2024DOI
Andrea Borghesi, Roberta Calegari
Hierarchical Knowledge Extraction from Opaque Machine Learning Predictors
Lecture Notes in Computer Science, AIxIA 2024 – Advances in Artificial Intelligence· 2024DOI
Federico Sabbatini, Roberta Calegari
ICE: An Evaluation Metric to Assess Symbolic Knowledge Quality
Lecture Notes in Computer Science, AIxIA 2024 – Advances in Artificial Intelligence· 2024DOI
Federico Sabbatini, Roberta Calegari
Long-Term Fairness Strategies in Ranking with Continuous Sensitive Attributes
· 2024
Giuliani L.; Misino E.; Calegari R.; Lombardi M.
Perspectives and Challenges of Telemedicine and Artificial Intelligence in Pediatric Dermatology
Children· 2024DOI
Daniele Zama; Andrea Borghesi; Alice Ranieri; Elisa Manieri; Luca Pierantoni; Laura Andreozzi; Arianna Dondi; Iria Neri; Marcello Lanari; Roberta Calegari
Proceedings of the 2nd Workshop on Fairness and Bias in AI (AEQUITAS 2024), co-located with 27th European Conference on Artificial Intelligence (ECAI 2024)
· 2024
Roberta Calegari; Virginia Dignum; Barry O'Sullivan
State Feedback Enhanced Graph Differential Equations for Multivariate Time Series Forecasting
International Joint Conference on Artificial Intelligence Organization· 2024DOI
Jiaxu Cui; Qipeng Wang; Yiming Zhao; Bingyi Sun; Pengfei Wang; Bo Yang
Symbolic Knowledge Comparison: Metrics and Methodologies for Multi-Agent Systems
· 2024
Sabbatini F.; Sirocchi C.; Calegari R.
Unmasking the Shadows: Leveraging Symbolic Knowledge Extraction to Discover Biases and Unfairness in Opaque Predictive Models
· 2024
Sabbatini F.; Calegari R.
Untying black boxes with clustering-based symbolic knowledge extraction
Intelligenza Artificiale· 2024DOI
Sabbatini F.; Calegari R.
A Cognitive Approach to Model Intelligent Collaboration in Human-Robot Interaction
· 2023
Cantucci F.; Falcone R.
A geometric framework for fairness
· 2023
Alessandro Maggio, Luca Giuliani, Roberta Calegari, Michele Lombardi, Michela Milano
Achieving Complete Coverage with Hypercube-Based Symbolic Knowledge-Extraction Techniques
· 2023DOI
Federico Sabbatini, Roberta Calegari
Assessing and Enforcing Fairness in the AI Lifecycle
· 2023DOI
Roberta Calegari, Gabriel G. Castañé, Michela Milano, Barry O'Sullivan
Curriculum–Based Reinforcement Learning for Pedestrian Simulation: Towards an Explainable Training Process
· 2023
Vizzari G.; Briola D.; Cecconello T.
ExACT Explainable Clustering: Unravelling the Intricacies of Cluster Formation
· 2023
Federico Sabbatini, Roberta Calegari
FAiRDAS: Fairness-Aware Ranking as Dynamic Abstract System
· 2023
Eleonora Misino, Roberta Calegari, Michele Lombardi, Michela Milano
Generalized Disparate Impact for Configurable Fairness Solutions in ML
· 2023DOI
Giuliani L.; Misino E.; Lombardi M.
Impact based fairness framework for socio-technical decision making
· 2023
Brännström, Mattias; Jiang, Lili; Aler Tubella, Andrea; Dignum, Virginia
N-Mates Evaluation: a New Method to Improve the Performance of Genetic Algorithms in Heterogeneous Multi-Agent Systems
· 2023
Paolo Pagliuca; Alessandra Vitanza
Unlocking Insights and Trust: The Value of Explainable Clustering Algorithms for Cognitive Agents
· 2023
Federico Sabbatini, Roberta Calegari
Unveiling Opaque Predictors via Explainable Clustering: The CReEPy Algorithm
· 2023
Federico Sabbatini, Roberta Calegari
Addressing Bias and Data Scarcity in AI-Based Skin Disease Diagnosis with Non-Dermoscopic Images
Information Flow Model (IFM) – Methodological Guide (v0.4 Validation Version)
IFM Research Team
Unfair Inequality in Education: A Benchmark for AI-Fairness Research (Aequitas WP7 Use Case S2)
Giovanelli, Joseph (Data curator)1 ORCID icon Magnini, Matteo (Data curator)1 ORCID icon James, Liam (Data curator)1 ORCID icon Ciatto, Giovanni (Data curator)1 ORCID icon Marrero, Angel S. (Data manager)2 ORCID icon Borghesi, Andrea (Data curat
Deliverables (31)
Demonstrators, pilots, prototypes
Demonstrators, pilots, prototypes
Demonstrators, pilots, prototypes
Data Management Plan
Demonstrators, pilots, prototypes
Demonstrators, pilots, prototypes
Demonstrators, pilots, prototypes
Demonstrators, pilots, prototypes
Documents, reports
Demonstrators, pilots, prototypes
Documents, reports
Documents, reports
Documents, reports
Other Results (1)
Periodic Reporting for period 1 - AEQUITAS (ASSESSMENT AND ENGINEERING OF EQUITABLE, UNBIASED, IMPARTIAL AND TRUSTWORTHY AI SYSTEMS)