Making The Invisible Visible for Off-Highway Machinery by Conveying Extended Reality Technologies

Digital, Industry & SpaceHORIZON-RIAID: 101092861
EC Contribution
€61,927
Consortium Size
11 orgs
Start Year
2023
Summary

THEIA-XR (Making the invisible visible for off-highway machinery by conveying extended reality technologies) aims at improving human-machine interaction in mobile machinery by enhancing user technology fit and extending reality technologies and functionalities. The results will make the invisible visible respectively the non-perceivable perceivable to the human operator, extending the perceivable range of the operator without negatively influencing the performance of the human while controlling the machinery. The project will ensure positive impact of eXtended Reality technologies on the safety, security trustworthiness and societal aspects of the interaction between the machine, the human operator and public/non-users, and furthermore create an XR workplace that enables positive user experiences of self-efficacy and meaningfulness of work.THEIA-XR will leverage a human-centred transdisciplinary and scenario-based co-design methodology with users, stakeholders and multidisciplinary researchers as a fully integrated project team. This methodology serves to collect human requirements and to design, develop and deploy the extended reality technologies for information presentation and interaction in the off-highway domain. The targeted extended reality technologies will enhance conventional human-machine interfaces through multi-modal information and interaction technologies, deploying innovative data visualization methods, force feedback technology and acoustic information.The THEIA-XR approach for improving the human operator tasks by deploying extended reality technologies will be initially validated and tested in three uses cases in the off-highway domain, targeting snow grooming, logistics and construction scenarios, integrating real end-users, public/non-users and real-life data from dedicated industrial environments.

Consortium (11)

Project Results (45)

Source: CORDIS, the EU research results database.

Publications (32)
3D Depth Experience in VR from Monocular Video
2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)· 2025DOI
Nickas', Christoph; Fleck, Philipp; Kernbauer, Thomas; Arth, Clemens
Assisted Trailer Parking using a Reverse Camera System and Inverse Kinematics
2025 IEEE Intelligent Vehicles Symposium (IV)· 2025DOI
Kreimer, Daniel; Fleck, Philipp; Kernbauer, Thomas; Arth, Clemens
International Journal of Human Computer Studies
International Journal of Human-Computer Studies· 2025DOI
Anna Leschanowsky; Anastasia Sergeeva; Judith Bauer; Sheetal Vijapurapu; Mateusz Dubiel
Making the Invisible Visible - AR supported situation awareness in the snow groomer operations
· 2025DOI
Helin, Kaj; Alesani, Andrea; Kuula, Timo
Thermochromic Temperature Measurement: Towards an Alternative to Thermal Cameras
2025 IEEE Sensors Applications Symposium (SAS)· 2025DOI
Nussbacher, Thomas; Fleck, Philipp; Arth, Clemens
Computers and Graphics
Computers & Graphics· 2024DOI
Kernbauer, Thomas; Tschulik, Maximilian; Fleck, Philipp; Arth, Clemens
Container Bridge Model using ESP cameras
· 2024
Franz Feichtinger
Distance and Odometry Measurements on Toy Car with VR Visualization
· 2024
Jakob Khom
Early-stage user experience design of the remote operation concept of the harbour's reachstacker by expoiting eXtended Reality
International Conference on Applied Human Factor and Ergonomics (AHFE) 2024· 2024DOI
Helin, K., Alesani, A., Kuula, T., & Goriachev, V.,
Entwicklung und Evaluation eines Extended-Reality-Bedieninterfaces für Baumaschinen zur Interaktion mit digitalen Baugrubendaten im Kontext BIM
· 2024DOI
Breitbarth, Tim
Extended Reality simulator to evaluate remote control interactions for reach stackers
· 2024DOI
Alesani, Andrea; Helin, Kaj; Goriachev, Vladimir; Kuula, Timo
In-Situ Virtual Reality Tour using a realtime 360° video stream
· 2024
Simon Fussi
Instant Segmentation and Fitting of Excavations in Subsurface Utility Engineering
Transactions on Vizualization and Computer Graphics (TVCG)· 2024DOI
Marco Stranner, Philipp Fleck, Dieter Schmalstieg, Clemens ARth
International Journal of Human Computer Studies
Proceedings of the 10th International Conference on Information Systems Security and Privacy, 2024· 2024DOI
Philippe Valoggia, Anastasia Sergeeva, Arianna Rossi, Wilhelmina Maria Botes
MIPI-Camera based Panoramic Camera Design and Implementation
· 2024
Lukas Fuchs
Spatial Augmented Reality for Heavy Machinery Using Laser Projections
· 2024DOI
Maximilian Tschulik, Thomas Kernbauer, Philipp Fleck, Clemens Arth
Spotlight Control for Real-Time Targeting
Computer Science Research Notes· 2024DOI
Heinemann, Mika; Thomas, Kernbauer; Fleck, Philipp; Arth, Clemens
Spotlight Control for Real-Time Targeting
· 2024
Mika Heinemann
Steering Wheel Control for Virtual Toy Car Driving
· 2024
Johannes Aigner
Laser-Projection based Augmented Reality for Snow Grooming
· 2023
Maximilian Tschulik
3D Depth Experience in VR from Monocular Video
Christoph Nickas
Bag of World Anchors for Instant Large-Scale Localization
IEEE Transactions on Visualization and Computer GraphicsDOI
Reyes Aviles, Fernando; Fleck, Philipp; Schmalstieg, Dieter; Arth, Clemens
Bridge XR: Towards a Cross-Realities Student/Teacher System - A mixed reality training environment
Franz Feichtinger
Combining DLP and Laser Projection for Augmented Reality Visualizations
Maximilian Tschulik
Design of a low-cost FMCW Ground-Penetrating Radar based on a single-board computer
Bernhard Englmair
Identifying Ethical Challenges in XR Implementations in the Industrial Domain: A Case of Off-Highway Machinery
Anastasia Sergeeva, Claudia Negri-Ribalta, Gabriele Lenzini
Making the invisible visible for off-highway machinery by conveying extended reality technologies
Proceedings of the 20th EuroXR International ConferenceDOI
Martijn Rooker, Michael Burmester, Gerald Fritz-Mayer, Clemens Arth, Sebastian Lorenz, Volker Waurich, Manuel Kulzer, Anastasia Sergeeva, Kaj Helin, Markku Pusenius, Benjamin Geslot, Daniel Röck, Pekka Yli-Paunu
Mobile Visual Search revisited
Timon Kanik
PanoTherm: Panoramic Thermal Imaging for Object Detection and Tracking
Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and ApplicationsDOI
Kernbauer, Thomas; Fleck, Philipp; Arth, Clemens
Rear-View Camera System for Trailer Parking
Daniel Kreimer
Spotlight Control for Real-Time Targeting
32. International Conference in Central Europe on Computer Graphics, Visualization and Computer VisionDOI
Heinemann, Mika; Thomas, Kernbauer; Fleck, Philipp; Arth, Clemens
XR application for remote operations
Andrea Alesani
Deliverables (12)
Other Results (1)
Periodic Reporting for period 1 - THEIA-XR (Making The Invisible Visible for Off-Highway Machinery by Conveying Extended Reality Technologies)