HUMAN-ROBOT SENSORIMOTOR AUGMENTATION - WEARABLE SENSORIMOTOR INTERFACES AND SUPERNUMERARY ROBOTIC LIMBS FOR HUMANS WITH UPPER-LIMB DISABILITIES

Digital, Industry & SpaceHORIZON-RIAID: 101070292
EC Contribution
€49,486
Consortium Size
10 orgs
Start Year
2022
Summary

HARIA re-defines the nature of physical human-robot interaction (HRI), laying the foundations of a new research field, i.e., human sensorimotor augmentation, whose constitutive elements are: i) AI-powered wearable and grounded supernumerary robotic limbs and wearable sensorimotor interfaces; ii) methods for augmentation enabling users to directly control and feel the extra limbs exploiting the redundancy of the human sensorimotor system through wearable interfaces; iii) clear target populations, i.e., chronic stroke and spinal cord injured individuals, and real-world application scenarios to demonstrate the extraordinary value of the paradigm shift that HARIA represents in HRI and the great impact on the motivation to re-use the paretic arm(s), with consequent improvement of the quality of life. Supernumerary limbs will be partially controlled by artificial intelligence, and partially under the direct control of the human who gains the agency of some motion parameters of the supernumerary limbs. From the control point of view, it is fundamental to find the right trade-off between motion task parameters that are controlled by the user, and the level of robot autonomy. This interplay is enabled by the wearable sensorimotor interface that establishes a connection between the human sensorimotor system and the system of actuators and sensors of the robot, allowing reciprocal awareness, trustworthiness and mutual understanding. HARIA finds its natural application in assisting people with uni- or bi-lateral upper limbs chronic motor disabilities. Technology and methodology developments will follow a user-centered design approach, as only patients with disabilities are fully aware of their real (still unmet) needs in real life activities. This project will also go beyond the application to health, starting a new era of intuitive and seamless human-robot augmentation by wearable sensorimotor interfaces and supernumerary limbs.

Consortium (10)

Project Results (47)

Source: CORDIS, the EU research results database.

Publications (32)
A modular architecture for trial-by-trial learning of redundant muscle activity patterns in novel sensorimotor tasks
· 2025DOI
Lucas Rebelo Dal’Bello, Denise Jennifer Berger, Daniele Borzelli, Etienne Burdet, Andrea d’Avella
Exploiting body redundancy to control supernumerary robotic limbs in human augmentation
The International Journal of Robotics Research· 2025DOI
Tommaso Lisini Baldi, Nicole D’Aurizio, Chiara Gaudeni, Sergio Gurgone, Daniele Borzelli, Andrea d’Avella, Domenico Prattichizzo
Quantifying the Sense of Control through the Hand Blink Reflex in Human-Robot Interaction
IEEE Transactions on Affective Computing· 2025DOI
Tommaso Lisini Baldi, Bernardo Brogi, Alessandro Giannotta, Gionata Salvietti, Domenico Prattichizzo, Simone Rossi
Towards a Hierarchical User Requirement Structure for Upper Limb Assistive Robotics
ACM Transactions on Human-Robot Interaction· 2025DOI
Susanne Frennert, Maria Pozzi, Johanna Persson, Mariagrazia D’Ippolito, Donatella Mattia, Eva Díez-Rodríguez, Antonio Oliviero, Sara Fernández-Canosa, Fátima Villamayor Vega, Alessandro Giannotta, Simone Rossi, Andrea D’avella, Domenico Prattichizzo
A High-Force Gripper with Embedded Multimodal Sensing for Powerful and Perception Driven Grasping
2024 IEEE-RAS 23rd International Conference on Humanoid Robots (Humanoids)· 2024DOI
Edoardo Del Bianco, Davide Torielli, Federico Rollo, Damiano Gasperini, Arturo Laurenzi, Lorenzo Baccelliere, Luca Muratore, Marco Roveri, Nikos G. Tsagarakis
A Laser-Guided Interaction Interface for Providing Effective Robot Assistance to People With Upper Limbs Impairments
IEEE Robotics and Automation Letters· 2024DOI
Davide Torielli, Liana Bertoni, Luca Muratore, Nikos Tsagarakis
A Wearable Pick-By-Haptics System to Improve Manual-Picking Tasks in Warehouses
2024 IEEE Haptics Symposium (HAPTICS)· 2024DOI
Leonardo Franco, Tommaso Lisini, Domenico Prattichizzo, Gionata Salvietti
AutoGPT+P: Affordance-based Task Planning using Large Language Models
Robotics: Science and Systems XX· 2024DOI
Timo Birr, Christoph Pohl, Abdelrahman Younes, Tamim Asfour
Can Stochastic Resonance Improve Sensorimotor Performance in Hand Motor Control?
IEEE Access· 2024DOI
Michele Pompilio, Nicole D’Aurizio, Tommaso Lisini Baldi, Gionata Salvietti, Simone Rossi, Domenico Prattichizzo
From Cage to Stage: Mapping Human Dance Movements Onto Industrial Robotic Arm Motion
Proceedings of the 9th International Conference on Movement and Computing· 2024DOI
Giuseppe Saviano, Alberto Villani, Domenico Prattichizzo
Human-Robot Collaborative Cable-Suspended Manipulation with Contact Distinction
IEEE Robotics and Automation Letters· 2024DOI
Giovanni Cortigiani, Monica Malvezzi, Domenico Prattichizzo, Maria Pozzi
Incomplete adaptation to surface movement during hand reaching
· 2024DOI
Priscilla Balestrucci, Matteo Bianchi, Colleen P. Ryan, Giulia Daniele, Alice Flamini, Fanny Valente, Francesco Lacquaniti, Alessandro Moscatelli
Incremental Learning of Full-Pose Via-Point Movement Primitives on Riemannian Manifolds
2024 IEEE International Conference on Robotics and Automation (ICRA)· 2024DOI
Tilman Daab, Noémie Jaquier, Christian Dreher, Andre Meixner, Franziska Krebs, Tamim Asfour
Kinematic Synergy Primitives for Human-Like Grasp Motion Generation
2024 IEEE International Conference on Robotics and Automation (ICRA)· 2024DOI
Julia Starke, Tamim Asfour
Online Minimization of the Robot Silhouette Viewed From Eye-to-Hand Camera
2024 IEEE International Conference on Robotics and Automation (ICRA)· 2024DOI
G. Cortigiani, B. Brogi, A. Villani, T. Lisini Baldi, N. D’Aurizio, D. Prattichizzo
Soft Human-Robot Handover Using a Vision-Based Pipeline
IEEE Robotics and Automation Letters· 2024DOI
Chiara Castellani, Enrico Turco, Valerio Bo, Monica Malvezzi, Domenico Prattichizzo, Gabriele Costante, Maria Pozzi
Soft Pneumatic Pads Enable New Sensing and Actuation Capabilities in Soft-Rigid Grippers
2024 IEEE 7th International Conference on Soft Robotics (RoboSoft)· 2024DOI
Maria Pozzi, Leonardo Franco, Zubair Iqbal, Monica Malvezzi, Domenico Prattichizzo, Gionata Salvietti
Synaptic inputs to motor neurons underlying muscle coactivation for functionally different tasks have different spectral characteristics
Journal of Neurophysiology· 2024DOI
Daniele Borzelli, Taian M. M. Vieira, Alberto Botter, Marco Gazzoni, Francesco Lacquaniti, Andrea d’Avella
The Avatarm: Interacting in the Physical Metaverse via Robotics, Diminished Reality, and Haptics
IEEE Access· 2024DOI
Bernardo Brogi, Giovanni Cortigiani, Alberto Villani, Nicole D’Aurizio, Domenico Prattichizzo, Tommaso Lisini Baldi
The Double-Scoop Gripper: A Tendon-Driven Soft-Rigid End-Effector for Food Handling Exploiting Constraints in Narrow Spaces
2024 IEEE International Conference on Robotics and Automation (ICRA)· 2024DOI
Leonardo Franco, Enrico Turco, Valerio Bo, Maria Pozzi, Monica Malvezzi, Domenico Prattichizzo, Gionata Salvietti
The HapticSpider: a 7-DoF Wearable Device for Cutaneous Interaction with the Palm
ACM· 2024DOI
"""L. Kuang, M. Malvezzi, D. Prattichizzo, P. Robuffo Giordano, F. Chinello, C. Pacchierotti """
The relativity of reaching: Motion of the touched surface alters the trajectory of hand movements
iScience· 2024DOI
Colleen P. Ryan, Simone Ciotti, Priscilla Balestrucci, Antonio Bicchi, Francesco Lacquaniti, Matteo Bianchi, Alessandro Moscatelli
Towards Unifying Human Likeness: Evaluating Metrics for Human-Like Motion Retargeting on Bimanual Manipulation Tasks
2024 IEEE International Conference on Robotics and Automation (ICRA)· 2024DOI
Andre Meixner, Mischa Carl, Franziska Krebs, Noémie Jaquier, Tamim Asfour
Wearable Haptics for a Marionette-inspired Teleoperation of Highly Redundant Robotic Systems
2024 IEEE International Conference on Robotics and Automation (ICRA)· 2024DOI
Davide Torielli, Leonardo Franco, Maria Pozzi, Luca Muratore, Monica Malvezzi, Nikos Tsagarakis, Domenico Prattichizzo
A hierarchical sensorimotor control framework for human-in-the-loop robotic hands.
Science Robotics· 2023DOI
Seminara L, Dosen S, Mastrogiovanni F, Bianchi M, Watt S, Beckerle P, Nanayakkara T, Drewing K, Moscatelli A, Klatzky RL, Loeb GE.
Avatarm: an Avatar With Manipulation Capabilities for the Physical Metaverse
Proc. IEEE Int. Conf. on Robotics and Automation· 2023DOI
Villani, A., Cortigiani, G., Brogi, B., D'Aurizio, N., Baldi, T. L.
Bayesian hierarchical models and prior elicitation for fitting psychometric functions
Front. Comput. Neurosci.· 2023DOI
Mezzetti M, Ryan CP, Balestrucci P, Lacquaniti F, Moscatelli A.
Exploiting Human Intrinsic Kinematic Null Space to Control Extra Degrees of Freedom
· 2023DOI
Lisini, Tommaso; D'Aurizio, Nicole; Prattichizzo, Domenico
Exploiting Intrinsic Kinematic Null Space for Supernumerary Robotic Limbs Control.
Proc. IEEE Int. Conf. on Robotics and Automation· 2023DOI
Lisini Baldi, T., D’Aurizio, N., Gurgone, S., Borzelli, D., d’Avella, A., & Prattichizzo, D.
Monolithic fingers with actively variable compliance for underactuated tendon-driven robotic grippers
· 2023DOI
Troisi, Danilo; Dragusanu, Mihai; Prattichizzo, Domenico; Malvezzi, Monica
Neuromuscular invariants in action execution and perception: Comment on “Motor invariants in action execution and perception” by Torricelli et al.
Physics of Life Reviews· 2023DOI
Andrea d'Avella; Marta Russo; Denise J. Berger; Antonella Maselli
Persistent changes in motor adaptation strategies after perturbations that require exploration of novel muscle activation patterns
Journal of Neurophysiology· 2023DOI
Berger DJ, d'Avella A
Deliverables (14)
Other Results (1)
Periodic Reporting for period 2 - HARIA (HUMAN-ROBOT SENSORIMOTOR AUGMENTATION - WEARABLE SENSORIMOTOR INTERFACES AND SUPERNUMERARY ROBOTIC LIMBS FOR HUMANS WITH UPPER-LIMB DISABILITIES)