Specializing TEmporal Planning using Reinforcement Learning

ERC (European Research Council)HORIZON-ERCID: 101115870
EC Contribution
€14,938
Consortium Size
1 orgs
Start Year
2024
Summary

Planning - devising a strategy to achieve a desired objective - is one of the basic forms of intelligence. Temporal planning studies the automated synthesis of strategies when time and temporal constraints matter. Temporal planning is one of the most strategic fields of Artificial Intelligence, with applications in autonomous robotics, logistics, flexible production, and many other fields.Historically, the research on temporal planning follows a general-purpose framework: a generic engine searches for the strategy by reasoning on the problem statement (i.e. the starting condition and the desired objective), as well as on a formal model of the domain (i.e. the possible actions). Despite substantial progress in the recent years, domain-independent temporal planning still suffers from scalability issues, and fails to deal with real-word problems. The alternative is to devise ad-hoc, domain-specific solutions that, although efficient, are costly to develop, rigid to maintain, and often inapplicable in non-nominal situations.STEP-RL will study the foundations of a new approach to Temporal Planning, that is domain-independent and efficient at the same time. The idea is to adopt a framework based on Reinforcement Learning, where a domain-independent temporal planner is specialized with respect to the domain at hand. STEP-RL continuously improves its ability to solve temporal planning problems by learning from experience, thus becoming increasingly efficient by means of self-adaptation.STEP-RL will advance the state of the art in temporal planning beyond the ""efficiency vs flexibility"" dilemma, that I had to personally face in the many industrial projects I worked on.""

Consortium (1)

Project Results (12)

Source: CORDIS, the EU research results database.

Publications (11)
Algorithm Configuration in the Unified Planning Framework
Lecture Notes in Computer Science, Learning and Intelligent Optimization· 2026DOI
Dimitri Weiß, Andrea Micheli, Kevin Tierney
Automatic Selection of Macro-Events for Heuristic-Search Temporal Planning
Proceedings of the AAAI Conference on Artificial Intelligence· 2025DOI
Alessandro La Farciola, Alessandro Valentini, Andrea Micheli
Counterfactual Scenarios for Automated Planning
Proceedings of the TwentySecond International Conference on Principles of Knowledge Representation and Reasoning· 2025DOI
Nicola Gigante, Francesco Leofante, Andrea Micheli
Exploiting Symbolic Heuristics for the Synthesis of Domain-Specific Temporal Planning Guidance Using Reinforcement Learning
Frontiers in Artificial Intelligence and Applications, ECAI 2025· 2025DOI
Irene Brugnara, Alessandro Valentini, Andrea Micheli
Generalizing Platform-Aware Mission Planning for Infinite-State Timed Transition Systems
Proceedings of the TwentySecond International Conference on Principles of Knowledge Representation and Reasoning· 2025DOI
Stefan Panjkovic, Alessandro Cimatti, Andrea Micheli, Stefano Tonetta
Learning of Lifted Macro-Events for Heuristic-Search Temporal Planning
Frontiers in Artificial Intelligence and Applications, ECAI 2025· 2025DOI
Alessandro La Farciola, Alessandro Valentini, Andrea Micheli
Platform-Aware Mission Planning
Proceedings of the International Conference on Automated Planning and Scheduling· 2025DOI
Stefan Panjkovic, Alessandro Cimatti, Andrea Micheli, Stefano Tonetta
Temporal Task and Motion Planning with Metric Time for Multiple Object Navigation
Proceedings of the AAAI Conference on Artificial Intelligence· 2025DOI
Elisa Tosello, Alessandro Valentini, Andrea Micheli
Unified Planning: Modeling, manipulating and solving AI planning problems in Python
SoftwareX· 2025DOI
Andrea Micheli; Arthur Bit-Monnot; Gabriele Röger; Enrico Scala; Alessandro Valentini 0001; Luca Framba; Alberto Rovetta; Alessandro Trapasso; Luigi Bonassi; Alfonso Emilio Gerevini; Luca Iocchi; Félix Ingrand; Uwe Köckemann; Fabio Patrizi; Alessandro Saetti; Ivan Serina; Sebastian Stock 0001
A Meta-Engine Framework for Interleaved Task and Motion Planning using Topological Refinements
Frontiers in Artificial Intelligence and Applications· 2024DOI
Elisa Tosello; Alessandro Valentini 0001; Andrea Micheli
Against the Clock: Lessons Learned by Applying Temporal Planning in Practice
Lecture Notes in Computer Science, AIxIA 2024 – Advances in Artificial Intelligence· 2024DOI
Andrea Micheli
Deliverables (1)
Data Management Plan