MetamorphoSis of cultural Heritage Into augmented hypermedia assets For enhanced accessibiliTy and inclusion

HORIZON.2.2HORIZON-RIAID: 101060660
EC Contribution
€35,273
Consortium Size
14 orgs
Summary

SHIFT is strategically conceived to deliver a set of loosely coupled, technological tools, that offers cultural heritage institutions the necessary impetus to stimulate growth, and embrace the latest innovations in artificial intelligence, machine learning, multi-modal data processing, digital content transformation methodologies, semantic representation, linguistic analysis of historical records, and the use of haptics interfaces to effectively and efficiently communicate new experiences to all citizens (including people with disabilities). The development of SHIFT tools will be carried out in close consultation with the stakeholder communities represented in the project. The two CH networks (BMN, ANBPR) will launch open consultation to aggregate views from their members, while together with the cultural heritage institutions (SOMKL, SMB) and heritage professionals (Heritage Management), will provide requirements based on the cultural assets being maintained within each organisation. The diversity of digital media transformation and the semantic formalisation of the cultural assets will be individually demonstrated across each museum and library. Additionally, the inclusion by design principles adopted within the project, will be evaluated by CH networks and vulnerable group partner (DBSV), who will engage with the various tools developed in the project. In complementary to the stakeholders and end-users, the SHIFT project also brings together leading industrial (SIMAVI) and academic institutions (FORTH, UAU, QMUL). The consortium is complemented by SMEs (MDS, AUD) with high-tech product development teams and ethical expertise (ERC). Collectively, the project will release 12 technology solutions clustered into five thematic areas (computer vision, audio, text-to-speech, haptics, semantics and linguistics) that support accessibility and inclusion by design to overcome the shortcomings and limitations of CCI sector to enable growth and stimulation.

Consortium (14)

Project Results (45)

Source: CORDIS, the EU research results database.

Publications (27)
ASSISTIVE SOLUTIONS BASED ON ARTIFICIAL INTELLIGENCE - IN SUPPORTING AN INCREASED ACCESS OF USERS WITH SPECIAL NEEDS TO MODERN LIBRARY SERVICES
INTED Proceedings, INTED2025 Proceedings· 2025DOI
Ioana Cornelia Cristina Crihană
Large Language Models for the Analysis of Project Proposals
Lecture Notes in Computer Science, Artificial Intelligence in HCI· 2025DOI
Iosif Tsangko, Andreas Triantafyllopoulos, Evangelos Kyriakidis, George Margetis, Björn W. Schuller
Pioneering Approach to Reforming Public Library Services: Exploring New Ways to Exploit the Results of the SHIFT Project
PCE Official Conference Proceedings, The Paris Conference on Education 2025: Official Conference Proceedings· 2025DOI
Ioana Cornelia Cristina Crihană
Public Libraries - Aggregators of New and Reusable Knowledge Resources for Users’ Creative Development
Communications in Computer and Information Science, Metadata and Semantic Research· 2025DOI
Ioana Cornelia Cristina Crihană
Reading Smiles: Proxy Bias in Foundation Models for Facial Emotion Recognition
IEEE Access· 2025DOI
Iosif Tsangko, Andreas Triantafyllopoulos, Adria Mallol-Ragolta, Björn W. Schuller
"""Challenges Regarding the Accessibility of Library Services in Heritage Conservation Using the Matrix of Users’ Consumption Behaviors"""
The 12th European Conference on Education (ECE2024) The 2024 IAFOR Summer Conference Series in London· 2024
Ioana Cornelia Cristina Crihană
“So . . . my child . . . ” – How Child ADHD Influences the Way Parents Talk
Proc. Interspeech 2024· 2024DOI
Spiesberger, A.A., Triantafyllopoulos, A., Kathan, A., Semertzidou, A., Gawrilow, C., Reinelt, T., Rauch, W.A., Schuller, B.W.
Are you sure? Analysing Uncertainty Quantification Approaches for Real-world Speech Emotion Recognition
Interspeech 2024· 2024DOI
Schrüfer, Oliver; Milling, Manuel; Burkhardt, Felix; Eyben, Florian; Schuller, Björn
BeWeB: rete di comunità e scenari digitali
DigItalia· 2024DOI
Paul Gabriele Weston; Angelo Cingari; Giulia Cruciani; Silvia Tichetti; Maria Teresa Rizzo
Beyond Deep Learning: Charting the Next Frontiers of Affective Computing
Intelligent Computing· 2024DOI
Andreas Triantafyllopoulos; Lukas Christ; Alexander Gebhard; Xin Jing; Alexander Kathan; Manuel Milling; Iosif Tsangko; Shahin Amiriparian; Björn W. Schuller
INCLUSION IN MUSEUMS: A COLLECTION OF BEST PRACTICES
· 2024
Manko, A., & Milošević Micić, M. (Eds.)
Navigating Accessibility: Reforming Library Services on Heritage Conservation through the Deep Analysis of User Consumption Models
Qualitative and Quantitative Methods in Libraries· 2024
Ioana Cornelia Cristina Crihană
Personalised Anomaly Detectors and Prototypical Representations for Relapse Detection from Wearable-Based Digital Phenotyping
2024 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW)· 2024DOI
Adria Mallol-Ragolta, Anika Spiesberger, Andreas Triantafyllopoulos, Björn Schuller
Personalised Anomaly Detectors and Prototypical Representations for Relapse Detection from Wearable-Based Digital Phenotyping
2024 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW)· 2024DOI
Mallol-Ragolta, Adria; Spiesberger, Anika; Triantafyllopoulos, Andreas; Schuller, Björn
Promoting Inclusive Innovation in Digital Technologies for Heritage Preservation
· 2024DOI
De Majo, Claudio (Editor)1 ORCID icon Cerato, Ivana (Project member)2 ORCID icon Davies, Robert (Project member)3 Eckford-Soper, Lisa (Project manager)4 ORCID icon Fiore, Marco (Project member)5 Kagkelidou, Maria (Project member)3 Olson, Nasri
Prototypical Networks for Speech Emotion Recognition in Spanish
· 2024DOI
Mallol-Ragolta, A., Spiesberger, A., Barba Salvador, A., Schuller, B.
Renewable Knowledge: Libraries as Catalysts for Lifelong Learning, Transformative Education and Reforming the Dynamics of Pre-existing Intellectual Acquiring Reuse
EDULEARN24 Proceedings· 2024
Ioana Cornelia Cristina Crihană
The Role of Libraries in Understanding and Processing Renewable Knowledge and in Putting it Back into the Collective Circuit: a Comprehensive Review
ICERI2024 Proceedings· 2024DOI
Ioana Cornelia Cristina Crihană
Wav2Small: Distilling Wav2Vec2 to 72K Parameters for Low-Resource Speech Emotion Recognition
· 2024
Dionyssos Kounadis Bastian, Oliver Schrufer, Anna Derington, Hagen Wierstorf, Florian Eyben,Felix Burkhardt, Bjorn W. Schuller
"""Do touch!"" - 3D Scanning and Printing Technologies for the Haptic Representation of Cultural Assets: A Study with Blind Target Users"
Conference Proceedings· 2023DOI
Arne Bruns, Anika A. Spiesberger, Andreas Triantafyllopoulos, Patric Müller, and Björn W. Schuller
A Framework for Accessibility in XR Environments
Communications in Computer and Information Science ISBN: 9783031492143· 2023DOI
Aikaterini Valakou; George Margetis; Stavroula Ntoa; Constantine Stephanidis
Abusive Speech Detection in Indic Languages Using Acoustic Features
INTERSPEECH 2023· 2023DOI
Spiesberger, Anika A.; Triantafyllopoulos, Andreas; Tsangko, Iosif; Schuller, Björn W.
Abusive Speech Detection in Indic Languages Using Acoustic Features
Proc. INTERSPEECH 2023· 2023DOI
Anika A. Spiesberger, Andreas Triantafyllopoulos, Iosif Tsangko, and Björn W. Schuller
audb -- Sharing and Versioning of Audio and Annotation Data in Python
· 2023DOI
Wierstorf, Hagen; Wagner, Johannes; Eyben, Florian; Burkhardt, Felix; Schuller, Björn W.
Educational Partnerships That Can Drive the Activation of Renewable Knowledge Process, Using the Public Libraries Infrastructure
The Paris Conference on Education· 2023DOI
Ioana Cornelia Cristina Crihană
Going Retro: Astonishingly Simple Yet Effective Rule-based Prosody Modelling for Speech Synthesis Simulating Emotion Dimensions
· 2023DOI
Burkhardt, Felix; Reichel, Uwe; Eyben, Florian; Schuller, Björn
Public Libraries – Hubs for Recovering and Valuing Renewable and Imuable Knowledge
The Barcelona Conference on Education 2023: Official Conference Proceedings· 2023DOI
Ioana Cornelia Cristina Crihană
Deliverables (17)
Other Results (1)
Periodic Reporting for period 1 - SHIFT (MetamorphoSis of cultural Heritage Into augmented hypermedia assets For enhanced accessibiliTy and inclusion)