Eyes for Information, Communication, and Understanding

MSCA (Marie Skłodowska-Curie)HORIZON-TMA-MSCA-DNID: 101072410
EC Contribution
€26,058
Consortium Size
20 orgs
Start Year
2022
Summary

Gaze is an important communication channel to be captured remotely which works even without language. It thus holds great potential for universal inclusive technologies. Eyes for information, communication, and understanding (Eyes4ICU) explores novel forms of gaze interaction that rely on current psychological theories and findings, computational modeling, as well as expertise in highly promising application domains. Its approach of developing inclusive technology by tracing gaze interaction back to its cognitive and affective foundations (a psychological challenge) results in better models to predict user behavior (a computational challenge). By integrating insights in application fields, gaze-based interaction can be employed in the wild. Accordingly, the proposed research is divided into three work packages, namely Understanding Users (WP1), Gaze Communication (WP2), and In The Wild (WP3). All three work packages are pursued from three different perspectives: a psychological empirical perspective, a computational modeling perspective, and an application perspective, ensuring a unified and aligned progress and concept. Along these lines, training is also divided into three packages of Empirical Research Methods (WP4), Computational Modeling (WP5), and Transferable Skills (WP6). Consequently, the consortium is composed of groups working in psychological, computing, and application fields. All Beneficiaries are experts in using eye tracking in their respective areas ensuring best practices and optimal facilities for research and training. A variety of Associated Partners from the whole chain of eye tracking services ensures for applicability, practical relevance, and career opportunities by contributing to supervision, training, and research. This will advance communication by eye tracking as a field and result in European standards for gaze-based communication in a variety of domains disseminated through research and application.

Consortium (20)

Project Results (38)

Source: CORDIS, the EU research results database.

Publications (28)
Fixations, blinks, and pupils differentially capture individual and interpersonal dynamics in role-asymmetric mutual gaze interaction
Scientific Reports· 2026DOI
Mehtap Çakır, Anke Huckauf
Influence of Stimulus Layout and Social Presence on Deception-Related Eye Movements and Blinks in the Concealed Information Test
Journal of Eye Movement Research· 2026DOI
Valentin Foucher, Anke Huckauf
A Multimodal Approach for Early Identification of Mild Cognitive Impairment and Alzheimer’s Disease With Fusion Network Using Eye Movements and Speech
IEEE Transactions on Neural Systems and Rehabilitation Engineering· 2025DOI
Hasnain Ali Shah, Sami Andberg, Anne M. Koivisto, Roman Bednarik
DiffGaze: A Diffusion Model for Modelling Fine-grained Human Gaze Behaviour on 360° Images
ACM Transactions on Interactive Intelligent Systems· 2025DOI
Chuhan Jiao, Yao Wang, Guanhua Zhang, Mihai Bâce, Zhiming Hu, Andreas Bulling
Eye tracking based detection of mild cognitive impairment: A review
Information Fusion· 2025DOI
Hasnain Ali Shah, Salman Khalil, Sami Andberg, Anne M. Koivisto, Roman Bednarik
Prediction of intrinsic and extraneous cognitive load with oculometric and biometric indicators
Scientific Reports· 2025DOI
Merve Ekin, Krzysztof Krejtz, Carlos Duarte, Andrew T. Duchowski, Izabela Krejtz
The effect of pupil size on data quality in head-mounted eye trackers
Behavior Research Methods· 2025DOI
Mohammadhossein Salari, Diederick C. Niehorster, Marcus Nyström, Roman Bednarik
Unsupervised Urban Land Use Mapping with Street View Contrastive Clustering and a Geographical Prior
Proceedings of the 33rd ACM International Conference on Advances in Geographic Information Systems· 2025DOI
Lin Che, Yizi Chen, Tanhua Jin, Martin Raubal, Konrad Schindler, Peter Kiefer
Investigating the Impact of Illumination Change on the Accuracy of Head-Mounted Eye Trackers: A Protocol and Initial Results
Companion Proceedings of the 26th International Conference on Multimodal Interaction· 2024DOI
Mohammadhossein Salari, Roman Bednarik
Understanding User Behavior in Carousel Recommendation Systems for Click Modeling and Learning to Rank
WSDM '24: The 17th ACM International Conference on Web Search and Data Mining· 2024DOI
Santiago de Leon-Martinez
A Review of Eye Tracking in Advanced Driver Assistance Systems: An Adaptive Multi-Modal Eye Tracking Interface Solution
ETRA '23: Proceedings of the 2023 Symposium on Eye Tracking Research and Applications· 2023DOI
Filippo Baldisserotto, Krzysztof Krejtz, Izabela Krejtz
Eye Tracking as a Source of Implicit Feedback in Recommender Systems: A Preliminary Analysis
2023 Symposium on Eye Tracking Research and Applications (ETRA '23)· 2023DOI
de Leon-Martinez, Santiago; Moro, Robert; Bielikova, Maria
Reviewing the Social Function of Eye Gaze in Social Interaction
ETRA '23: Proceedings of the 2023 Symposium on Eye Tracking Research and Applications· 2023DOI
Mehtap Çakır, Anke Huckauf
SUPREYES: SUPer Resolutin for EYES Using Implicit Neural Representation Learning
Proc. ACM Symposium on User Interface Software and Technology (UIST)· 2023DOI
Chuhan Jiao, Zhiming Hu, Mihai Bace, Andreas Bulling
Towards gaze-supported emotion-enhanced travel experience logging
Proceedings of the 18th International Conference on Location Based Services.· 2023DOI
Wang, Y., Raubal, M., & Kiefer, P.
Towards Personalized Pedestrian Route Recommendation Based on Implicit Visual Preference
Proceedings of the 18th International Conference on Location Based Services.· 2023DOI
Che, L., Raubal, M., & Kiefer, P.
Using Eye Tracking to detect Faking Intentions
ETRA '23: Proceedings of the 2023 Symposium on Eye Tracking Research and Applications· 2023DOI
Valentin Foucher, Anke Huckauf
Analyzing Dynamic Outdoor Eye-Tracking Data
Journal of Digital Landscape ArchitectureDOI
Brent Chamberlain, David Evans, Laura Schalbetter, Peter Kiefer, Adrienne Grêt-Regamey, Ulrike Wissen Hayek
Cognitive Load and Oculometrics in the Educational Scenarios: A Systematic Review and Meta-Analysis.
Proceedings of the ACM on Human-Computer Interaction.DOI
Ekin, M., Krejtz, K., & Krejtz, I.
Comparing elicited emotions during wayfinding in virtual and real geospatial environments
Wang, Y., Raubal, M., Kiefer, P.
Dynamics of Visual Attention in Novice Heavy-Machine Operators.
In 2025 Symposium on Eye Tracking Research and ApplicationsDOI
Baldisserotto, F., Krejtz, I., Bogucka, K., Maciąg, Z., & Krejtz, K.
Eye Movements as Indicators of Deception: A Machine Learning Approach.
In 2025 Symposium on Eye Tracking Research and ApplicationsDOI
Foucher, V., de Leon-Martinez, S., & Moro, R.
HAGI: Head-Assisted Gaze Imputation for Mobile Eye Trackers
UIST '25: Proceedings of the 38th Annual ACM Symposium on User Interface Software and TechnologyDOI
Jiao, C., Hu, Z., & Bulling, A.
Radioactive Eye Information: Guarding Eye-Image Datasets through Radioactive Watermarking for Unauthorized-Use Detection.
In 2025 Symposium on Eye Tracking Research and ApplicationsDOI
Kovacs, D., Madsen, I. J. W., & Witzner Hansen, D.
RecGaze: The First Eye Tracking and User Interaction Dataset for Carousel Interfaces
Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’25)DOI
Santiago de Leon-Martinez, Jingwei Kang, Robert Moro, Maarten de Rijke, Branislav Kveton, Harrie Oosterhuis, Maria Bielikova
Rethinking Click Models in Light of Carousel Interfaces: Theory-Based Categorization and Design of Click Models.
Proceedings of the 2025 ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR '25)DOI
Jingwei Kang, Maarten de Rijke, Santiago de Leon-Martinez, Harrie Oosterhuis
Unveiling Deceptive Intentions: Insights from Fixations and Pupil Size.
Proceedings of the 2024 Symposium on Eye Tracking Research and Applications (ETRA '24)DOI
Valentin Foucher, Anke Huckauf
What Eyeblinks Reveal: Interpersonal Synchronization in Dyadic Interaction.
Proceedings of the 2024 Symposium on Eye Tracking Research and Applications (ETRA '24)DOI
Mehtap Cakir, Anke Huckauf
Other Results (1)
Periodic Reporting for period 1 - Eyes4ICU (Eyes for Information, Communication, and Understanding)
Deliverables (9)