Human Centered Technologies for a Safer and Greener European Construction Industry

Digital, Industry & SpaceHORIZON-RIAID: 101058236
EC Contribution
€90,668
Consortium Size
22 orgs
Start Year
2022
Summary

The European construction industry faces three major challenges: improve its productivity, increase the safety and wellbeing of its workforce and make a shift towards a green, resource efficient industry. To address these challenges adequately, HumanTech proposes a human-centered approach, involving breakthrough technologies such as wearables for worker safety and support, and intelligent robotic technology that can harmoniously co-exist with human workers while also contributing to the green transition of the industry. Our aim is to achieve major advances beyond the current state-of-the-art in all these technologies, that can have a disruptive effect in the way construction is conducted by a new generation of highly skilled, male and female construction workers and engineers, working in a safe and rewarding digitally enabled environment. These advances will include: Introduction of robotic devices equipped with vision and intelligence to enable them to navigate autonomously and safely in a highly unstructured environment, collaborate with humans and dynamically update a semantic digital twin of the construction site. Visual information capturing will extend to multispectral imaging enabling detection of material composition of built structures besides geometric characteristics. Intelligent unobtrusive workers protection and support equipment ranging from exoskeletons triggered by wearable body pose and strain sensors, to wearable cameras and XR glasses to provide real-time worker localisation and guidance for the efficient and accurate fulfilment of their tasks. An entirely new breed of Dynamic Semantic Digital Twins (DSDTs) of construction sites simulating in detail the current state of a construction site at geometric and semantic level, based on an extended BIM formulation encompassing all relevant structural and semantic dimensions (BIMxD). BIMxDs will act as a common reference for all human workers, engineers and autonomous machines.

Consortium (22)

Project Results (53)

Source: CORDIS, the EU research results database.

Publications (18)
Resolving Symmetry Ambiguity in Correspondence-Based Methods for Instance-Level Object Pose Estimation
IEEE Transactions on Image Processing· 2025DOI
Yongliang Lin, Yongzhi Su, Sandeep Inuganti, Yan Di, Naeem Ajilforoushan, Hanqing Yang, Yu Zhang, Jason Rambach
Robot Learning from Teleoperated Demonstrations: A Pilot Study Towards Automating Mastic Deposition in Construction Sites
Robotics· 2025DOI
Irati Rasines, Erlantz Loizaga, Rebecca Erlebach, Anurag Bansal, Sara Sillaurren, Patricia Rosen, Sascha Wischniewski, Arantxa Renteria, Itziar Cabanes
ToF-360 – A Panoramic Time-of-flight RGB-D Dataset for Single Capture Indoor Semantic 3D Reconstruction
· 2025DOI
Hideaki Kanayama; Mahdi Chamseddine; Suresh Guttikonda; So Okumura; Soichiro Yokota; Didier Stricker; Jason Raphael Rambach
BRep Boundary and Junction Detection for CAD Reverse Engineering
2024 IEEE 3rd International Conference on Computing and Machine Intelligence (ICMI)· 2024DOI
Sk Aziz Ali, Mohammad Sadil Khan, Didier Stricker
Federating cross-domain BIM-based knowledge graph
Advanced Engineering Informatics· 2024DOI
Wojciech Teclaw, James O’Donnel, Ville Kukkonen, Pieter Pauwels, Nathalie Labonnote, Eilif Hjelseth
HiPose: Hierarchical Binary Surface Encoding and Correspondence Pruning for RGB-D 6DoF Object Pose Estimation
· 2024DOI
Yongliang Lin; Yongzhi Su; Praveen Nathan; Sandeep Inuganti; Yan Di; Martin Sundermeyer
How many Robots is too many? Findings about Single-Human Multiple-Robot Systems
AHFE International, Human Interaction and Emerging Technologies (IHIET 2024)· 2024DOI
Estefany Rey-becerra, Sascha Wischniewski
IFC Properties Validation Using Deep Graph Neural Network
2024 9th International Conference on Smart and Sustainable Technologies (SpliTech)· 2024DOI
Wojciech Teclaw, Reidar Kind, Nathalie Labonnote
Robots Adapting to the Environment: A Review on the Fusion of Dynamic Movement Primitives and Artificial Potential Fields
IEEE Access· 2024DOI
Irati Rasines, Itziar Cabanes, Anthony Remazeilles, Joseph Mcintyre
SG-PGM: Partial Graph Matching Network with Semantic Geometric Fusion for 3D Scene Graph Alignment and its Downstream Tasks
2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)· 2024DOI
Yaxu Xie, Alain Pagani, Didier Stricker
Task Automation in Construction Sites: Robot Learning from Teleoperated Demonstrations
2024 7th Iberian Robotics Conference (ROBOT)· 2024DOI
Irati Rasines, Miguel Prada, Alfonso Dominguez, Elisa Prada, Anthony Remazeilles, Itziar Cabanes Axpe
Zukunft der Bauindustrie: Einsatzbedingungen, Chancen und Risiken von innovativen Assistenztechnologien aus der Beschäftigtenperspektive
· 2024
P. H. Rosen, J. Rambach, G. Callinan, S. Sillaurren Landaburu, P. Tegtmeier, S. Wischniewski
Annotation rules and classes for semantic segmentation of point clouds for digitalization of existing bridge structures
2023 European Conference on Computing in Construction· 2023DOI
Marius Schellen, Fabian Kaufmann , Christian Glock and Thomas Tschickardt
BIM-based construction quality assessment using Graph Neural Networks
2023 Proceedings of the 40th ISARC, Chennai, India· 2023DOI
Navid Kayhani, Brenda McCabe, and Bharath Sankaran
Ontology-Based Semantic Labelling for RGB-D and Point Cloud Datasets
2023 European Conference on Computing in Construction – 40th International CIB W78 Conference· 2023DOI
Fabian Kaufmann, Mahdi Chamseddine, Suresh Guttikonda, Christian Glock, Didier Stricker and Jason Rambach
OPA-3D: Occlusion-Aware Pixel-Wise Aggregation for Monocular 3D Object Detection
IEEE Robotics and Automation Letters· 2023DOI
Yongzhi Su , Yan Di , Guangyao Zhai , Graduate Student Member, IEEE, Fabian Manhardt, Jason Rambach, Benjamin Busam , Didier Stricker, and Federico Tombari
Single Frame Semantic Segmentation Using Multi-Modal Spherical Images
IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2024)· 2023DOI
Suresh Guttikonda, Jason Rambach
U-RED: Unsupervised 3D Shape Retrieval and Deformation for Partial Point Clouds
ICCV Conference 2023· 2023DOI
Yan Di , Chenyangguang Zhang , Ruida Zhang , Fabian Manhardt , Yongzhi Su , Jason Rambach , Didier Stricker , Xiangyang Ji and Federico Tombari
Deliverables (34)
3D point cloud semantic segmentation algorithm
Other
BIMxD IDM with classes and attributes according to ISO 29481 and respective standards
Documents, reports
BIMxD XR visualization prototype
Other
Body sensor network with integrated camera approach
Documents, reports
bSDD specification from BIMxD
Documents, reports
Communication framework for control and supervision
Documents, reports
Complete Scan-to-BIMxD Digital Twin pipeline
Documents, reports
Development of the ontology for demolition task planning
Documents, reports
Domain-adapted synthetic dataset for 3D semantic segmentation
Data sets, microdata, etc
HT Dissemination and Communication Final Report
Documents, reports
HT Dissemination and Communication Interim Report
Documents, reports
HT Impact Master Plan
Documents, reports
HT micro-learning unit descriptors
Documents, reports
HT safety, gender and ethics report
Documents, reports
HT user requirements and ethics approach
Documents, reports
HT worker assessment report - final
Documents, reports
HT worker assessment report - initial
Documents, reports
Hyperspectral material scanning approach
Documents, reports
IFC schema extension
Documents, reports
Intelligent exoskeleton with intention prediction prototype
Documents, reports
Mobile platform demonstration
Demonstrators, pilots, prototypes
Open source BIM authoring tools: Framework and Software Modules
Other
Pilot I - Dynamic semantic digital twin
Demonstrators, pilots, prototypes
Pilot II - Human-Robot collaboration and wearables
Demonstrators, pilots, prototypes
Pilot III - Remote controlled demolition
Demonstrators, pilots, prototypes
Pilot IV - Bridge inspection and monitoring
Demonstrators, pilots, prototypes
Pilot V - Robotic mastic application
Demonstrators, pilots, prototypes
Scientific report on hybrid haptic-visual feedback mechanisms for efficient teleoperation of demolition robots
Documents, reports
Scientific report on teaching control policies by teleoperation
Documents, reports
Scientific report on unseen object class and shape estimation for robotic grasping
Documents, reports
The HT vision and research requirements
Documents, reports
Training monitoring and evaluation report
Documents, reports
Wearable-user localization algorithm
Documents, reports
Workflow capturing scientific report
Documents, reports
Other Results (1)
Periodic Reporting for period 1 - HumanTech (Human Centered Technologies for a Safer and Greener European Construction Industry)