Cognitive robotic tools for human-centered small-scale multi-robot operations

HORIZON.2.4HORIZON-RIAID: 101070066
EC Contribution
€45,857
Consortium Size
8 orgs
Summary

Robots are still often regarded as large machines with links, gears, and electric motors, autonomously interacting with the surrounding environment. Despite the great research efforts in robotics and human-robot interaction (HRI), the way we design, use, and control robots has not fundamentally changed in the past 20 years. We see in small-scale wireless multi-robot systems and cognitive HRI a revolutionary answer to nowadays robots limitations. Instead of large, tethered machines, that are difficult for the human user to control, REGO proposes an innovative set of AI-powered, modular, microsized swarms of robots. They are wirelessly steered by electromagnetic fields as well as able to react to other external stimuli, and then naturally controlled by humans through intuitive dexterous interfaces and interaction techniques. Taking advantage of AI multi-robot control strategies, these robots can team up and collaborate to fulfill complex tasks in a robust and unprecedented flexible way. By exploiting multisensory interaction techniques and cognitive shared control, the operator will achieve an unparalleled level of seamless interaction and continuous collaboration with the robotic team. According to the application at hand, the robotic team will feature different task-specific characteristics (e.g., biocompatibility for medical procedures, biodenitrification for cleaning water, ability to carry drugs to fight infections) and be dispatched through various delivery systems, including a stimuli-responsive milli-scale wireless robotic carrier developed within the project. To achieve this revolution, REGO will develop magnetic multi-robot motion control systems, autonomous swarm control techniques for micro-sized robots, human-robot haptic-centered interfaces, and cognitive shared-control techniques. REGO enables the next generation of AI-powered interactive small-size multi-robots systems, with increased capabilities to work with each other and their human operators.

Consortium (8)

Project Results (57)

Source: CORDIS, the EU research results database.

Publications (42)
"Surface-Symmetry-Driven Dzyaloshinskii-Moriya Interaction and Canted Ferrimagnetism in Collinear Magnetoelectric Antiferromagnet <mml:math xmlns:mml=""http://www.w3.org/1998/Math/MathML"" display=""inline""><mml:mrow><mml:msub><mml:mrow><mml:mi>Cr</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msub><mml:msub><mml:mrow><mml:mi mathvariant=""normal"">O</mml:mi></mml:mrow><mml:mrow><mml:mn>3</mml:mn></mml:mrow></mml:msub></mml:mrow></mml:math>"
Physical Review Letters· 2025DOI
Oleksandr V. Pylypovskyi, Sophie F. Weber, Pavlo Makushko, Igor Veremchuk, Nicola A. Spaldin, Denys Makarov
Cutaneous/Tactile Haptic Feedback in Robotic Teleoperation: Motivation, Survey, and Perspectives
IEEE Transactions on Robotics· 2025DOI
Claudio Pacchierotti, Domenico Prattichizzo
Flexible anisotropic magnetoresistive sensors for novel eddy current testing applications
Measurement· 2025DOI
Alberto Nicolicea, Eduardo Sergio Oliveros-Mata, Denys Makarov, Michael Melzer, Matthias Pelkner
Janus Particles in Acoustofluidic Setup: The Interplay between Self-Propulsion and Acoustic Trapping
Micro· 2025DOI
Lisa Marie Benko, Vyacheslav R. Misko, Larysa Baraban, Denys Makarov, Antonio Maisto, Wim De Malsche
Magnetic Nozzle‐Free Embedded 3D (MagNoFE3D) Printing
Advanced Materials Technologies· 2025DOI
Franco N. Piñan Basualdo, Vasileios D. Trikalitis, Sabrina Visconti, Fanny Ficuciello, Constantinos Goulas, Jeroen Rouwkema, Sarthak Misra
Printed Recyclable and Flexible Thermocouple Temperature Sensors
Advanced Sensor Research· 2025DOI
Xiaotao Wang, Lin Guo, Qihao Zhang, Yevhen Zabila, Rui Xu, Denys Makarov
Scalable magnetoreceptive e-skin for energy-efficient high-resolution interaction towards undisturbed extended reality
Nature Communications· 2025DOI
Pavlo Makushko, Jin Ge, Gilbert Santiago Cañón Bermúdez, Oleksii Volkov, Yevhen Zabila, Stanislav Avdoshenko, Rico Illing, Leonid Ionov, Martin Kaltenbrunner, Jürgen Fassbender, Rui Xu, Denys Makarov
Spin-orbit interaction driven terahertz nonlinear dynamics in transition metals
npj Spintronics· 2025DOI
Ruslan Salikhov, Markus Lysne, Philipp Werner, Igor Ilyakov, Michael Schüler, Thales V. A. G. de Oliveira, Alexey Ponomaryov, Atiqa Arshad, Gulloo Lal Prajapati, Jan-Christoph Deinert, Pavlo Makushko, Denys Makarov, Thomas Cowan, Jürgen Fassbender, Jürgen Lindner, Aleksandra Lindner, Carmine Ortix, Sergey Kovalev
Submersible touchless interactivity in conformable textiles enabled by highly selective overbraided magnetoresistive sensors
Communications Engineering· 2025DOI
Pasindu Lugoda, Eduardo Sergio Oliveros-Mata, Kalana Marasinghe, Rahul Bhaumik, Niccolò Pretto, Carlos Oliveira, Tilak Dias, Theodore Hughes-Riley, Michael Haller, Niko Münzenrieder, Denys Makarov
Versatile Green Transfer of Magnetoelectronics with Loss‐Free Performance and High Adhesion for Interactive Electronics
Advanced Functional Materials· 2025DOI
Olha Bezsmertna, Rui Xu, Eduardo Sergio Oliveros Mata, Stanislav Avdoshenko, Clemens Voigt, Sindy Mosch, Mykola Vinnichenko, Denys Makarov
Wearable multi-sensory haptic devices
Nature Reviews Bioengineering· 2025DOI
Joshua J. Fleck, Zane A. Zook, Janelle P. Clark, Daniel J. Preston, Darren J. Lipomi, Claudio Pacchierotti, Marcia K. O’Malley
A 4-DoF wearable hand device for haptic rendering of surfaces and edges
Mechatronics· 2024DOI
Lisheng Kuang, Monica Malvezzi, Marco Ferro, Domenico Prattichizzo, Paolo Robuffo Giordano, Francesco Chinello, Claudio Pacchierotti
A tunable room-temperature nonlinear Hall effect in elemental bismuth thin films
Nature Electronics· 2024DOI
Pavlo Makushko, Sergey Kovalev, Yevhen Zabila, Igor Ilyakov, Alexey Ponomaryov, Atiqa Arshad, Gulloo Lal Prajapati, Thales V. A. G. de Oliveira, Jan-Christoph Deinert, Paul Chekhonin, Igor Veremchuk, Tobias Kosub, Yurii Skourski, Fabian Ganss, Denys Makarov, Carmine Ortix
A Wearable Haptic Device for the Hand With Interchangeable End-Effectors
IEEE Transactions on Haptics· 2024DOI
Lisheng Kuang, Marco Ferro, Monica Malvezzi, Domenico Prattichizzo, Paolo Robuffo Giordano, Francesco Chinello, Claudio Pacchierotti
Bimanual Ultrasound Mid-Air Haptics for Virtual Reality Manipulation
IEEE Transactions on Visualization and Computer Graphics· 2024DOI
Lendy Mulot, Thomas Howard, Guillaume Gicquel, Claudio Pacchierotti, Maud Marchal
Can we Effectively Combine Tangibles and Ultrasound Mid-Air Haptics? A Study of Acoustically Transparent Tangible Surfaces
IEEE Transactions on Haptics· 2024DOI
Thomas Howard, Guillaume Gicquel, Claudio Pacchierotti, Maud Marchal
Collaborative Magnetic Agents for 3D Microrobotic Grasping
Advanced Intelligent Systems· 2024DOI
Franco N. Piñan Basualdo, Sarthak Misra
Deconstructing Haptic Feedback Information in Robot-Assisted Needle Insertion in Soft Tissues
IEEE Transactions on Haptics· 2024DOI
Marco Ferro, Claudio Pacchierotti, Sara Rossi, Marilena Vendittelli
Does Multi-Actuator Vibrotactile Feedback Within Tangible Objects Enrich VR Manipulation?
IEEE Transactions on Visualization and Computer Graphics· 2024DOI
Pierre-Antoine Cabaret, Thomas Howard, Guillaume Gicquel, Claudio Pacchierotti, Marie Babel, Maud Marchal
Graph Neural Network-Based Real-Time 3D Tracking for Micro-Agent Control
2024 International Conference on Manipulation, Automation and Robotics at Small Scales (MARSS)· 2024DOI
Yuxin Jin, Franco Pinan Basualdo, Antonio Marino, Yongfeng Mei, Paolo Robuffo Giordano, Claudio Pacchierotti, Sarthak Misra
Haptic Feedback, Performance and Arousal: A Comparison Study in an Immersive VR Motor Skill Training Task
IEEE Transactions on Haptics· 2024DOI
Unnikrishnan Radhakrishnan, Lisheng Kuang, Konstantinos Koumaditis, Francesco Chinello, Claudio Pacchierotti
Investigating the Haptic Perception of Directional Information Within a Handle
IEEE Transactions on Haptics· 2024DOI
Inès Lacôte, Claudio Pacchierotti, Marie Babel, David Gueorguiev, Maud Marchal
Kinetically controlled metal-elastomer nanophases for environmentally resilient stretchable electronics
Nature Communications· 2024DOI
Soosang Chae, Won Jin Choi, Lisa Julia Nebel, Chang Hee Cho, Quinn A. Besford, André Knapp, Pavlo Makushko, Yevhen Zabila, Oleksandr Pylypovskyi, Min Woo Jeong, Stanislav Avdoshenko, Oliver Sander, Denys Makarov, Yoon Jang Chung, Andreas Fery, Jin Young Oh, Tae Il Lee
Locally Addressable Energy Efficient Actuation of Magnetic Soft Actuator Array Systems
Advanced Science· 2024DOI
Michiel Richter, Jakub Sikorski, Pavlo Makushko, Yevhen Zabila, Venkatasubramanian Kalpathy Venkiteswaran, Denys Makarov, Sarthak Misra
Low-temperature diffusion in thin-film Pt-(Au-)-Co heterostructures: a structural and magnetic characterization
Nanotechnology· 2024DOI
Roman Pedan, Pavlo Makushko, Yurii Yavorskyi, Oleksandr Dubikovskyi, Andrii Bodnaruk, Andrii Burmak, Vladimir Golub, Svitlana Voloshko, René Hübner, Denys Makarov, Igor Vladymyrskyi
Medical Microrobots
Annual Review of Biomedical Engineering· 2024DOI
Veronica Iacovacci, Eric Diller, Daniel Ahmed, Arianna Menciassi
Millimeter-Scale Magnetic Carrier for On-Demand Delivery of Magnetic and Non-Magnetic Microparticles Suspensions
2024 10th IEEE RAS/EMBS International Conference for Biomedical Robotics and Biomechatronics (BioRob)· 2024DOI
Tamerlan Srymbetov, Giordano De Angelis, Arianna Menciassi, Veronica Iacovacci
Miniaturized Variable Stiffness Gripper Locally Actuated by Magnetic Fields
Advanced Intelligent Systems· 2024DOI
Lukas Masjosthusmann, Michiel Richter, Pavlo Makushko, Denys Makarov, Sarthak Misra
Multi-UAVs End-to-End Distributed Trajectory Generation Over Point Cloud Data
IEEE Robotics and Automation Letters· 2024DOI
Antonio Marino, Claudio Pacchierotti, Paolo Robuffo Giordano
Optical Flow and Acoustic Phase Analysis Comparison in Ultrasound-Based Microrobot Tracking
IEEE Robotics and Automation Letters· 2024DOI
Giovanni Faoro, Veronica Iacovacci, Arianna Menciassi
Printed magnetoresistive sensors for recyclable magnetoelectronics
Journal of Materials Chemistry A· 2024DOI
Xiaotao Wang, Lin Guo, Olha Bezsmertna, Yuhan Wu, Denys Makarov, Rui Xu
Reducing Cognitive Load in Teleoperating Swarms of Robots through a Data-Driven Shared Control Approach
2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)· 2024DOI
Enrico Turco, Chiara Castellani, Valerio Bo, Claudio Pacchierotti, Domenico Prattichizzo, Tommaso Lisini Baldi
The effect of Ar+ and N+ ion irradiation on the thermally induced evolution of the structural and magnetic properties of Co/Pt and Pt/Co bilayered stacks
Materials Chemistry and Physics· 2024DOI
Roman Pedan, Ivan Kruhlov, Pavlo Makushko, Oleksandr Dubikovskyi, Oleksandr Kosulya, Andrii Orlov, Andrii Bodnaruk, Vladimir Golub, Frans Munnik, René Hübner, Denys Makarov, Igor Vladymyrskyi
Three-dimensional magnetic nanotextures with high-order vorticity in soft magnetic wireframes
Nature Communications· 2024DOI
Oleksii M. Volkov, Oleksandr V. Pylypovskyi, Fabrizio Porrati, Florian Kronast, Jose A. Fernandez-Roldan, Attila Kákay, Alexander Kuprava, Sven Barth, Filipp N. Rybakov, Olle Eriksson, Sebastian Lamb-Camarena, Pavlo Makushko, Mohamad-Assaad Mawass, Shahrukh Shakeel, Oleksandr V. Dobrovolskiy, Michael Huth, Denys Makarov
Transferring human emotions to robot motions using Neural Policy Style Transfer
Cognitive Systems Research· 2024DOI
Raul Fernandez-Fernandez, Bartek Łukawski, Juan G. Victores, Claudio Pacchierotti
Tunable Magnetic Trap: Using Passive Elements to Control Magnetic Microrobots
IEEE Robotics and Automation Letters· 2024DOI
Franco N. Piñan Basualdo, Robert G. J. van de Weerd, Sarthak Misra
Ultrasound Mid-Air Haptics for Hand Guidance in Virtual Reality
IEEE Transactions on Haptics· 2024DOI
Lendy Mulot, Thomas Howard, Claudio Pacchierotti, Maud Marchal
Visuo-Haptic Rendering of the Hand during 3D Manipulation in Augmented Reality
IEEE Transactions on Haptics· 2024DOI
Erwan Normand, Claudio Pacchierotti, Eric Marchand, Maud Marchal
Haptic Mushroom: a 3-DoF shape-changing encounter-type haptic device with interchangeable end-effectors
2023 IEEE World Haptics Conference (WHC)· 2023DOI
Lisheng Kuang, Francesco Chinello, Paolo Robuffo Giordano, Maud Marchal, Claudio Pacchierotti
Improving the Perception of Mid-air Tactile Shapes with Spatio-temporally-modulated Tactile Pointers
ACM Transactions on Applied Perception· 2023DOI
Lendy Mulot, Thomas Howard, Claudio Pacchierotti, Maud Marchal
Magnetically aware actuating composites: Sensing features as inspiration for the next step in advanced magnetic soft robotics
Physical Review Applied· 2023DOI
Eduardo Sergio Oliveros-Mata, Rui Xu, Lin Guo, Denys Makarov
Modular Droplet‐Based Fluidics for Large Volume Libraries of Individual Multiparametric Codes in Lab‐On‐Chip Systems
Advanced Sensor Research· 2023DOI
Julian Schütt, Hariharan Nhalil, Jürgen Fassbender, Lior Klein, Asaf Grosz, Denys Makarov
Deliverables (15)