Compressed Indexes for Regular Languages with Applications to Computational Pan-genomics

HORIZON.1.1HORIZON-ERCID: 101039208
EC Contribution
€13,857
Consortium Size
1 orgs
Summary

Sorting is, arguably, the most powerful algorithmic primitive when it comes to indexing data. At the same time, the regularities exposed by sorting are precisely those enabling data compression. In the last two decades, this fascinating duality has led researchers to the design of compressed full-text indexes: data structures supporting fast pattern matching queries over compressed text. In this project, we revisit the natural generalization of the problem to labeled graphs from a new perspective: we interpret graphs as finite-state automata and investigate the connections existing between their propensity to be sorted and the languages they recognize. Our novel language-theoretic approach makes it possible to transfer fundamental results between the mature fields of regular language theory and compressed text indexing. We aim at building this bridge by developing a new theory of compressed regular language indexing. This project finds fundamental applications to the rapidly-expanding field of computational pan-genomics, where the goal is to study the variations contained in the genomes of an entire population. Recent research has shown that representing pan-genomes as labeled graphs is an important step to reduce reference allele bias. Existing approaches, however, can index only restricted classes of graphs, thereby limiting the practical applicability of such powerful pan-genome representations. Our innovative approach, based on sorting regular languages by partial co-lexicographic orders, changes the perspective from which the compressed indexing problem has been tackled in the literature. This project aims at developing a theory of graph indexing and compression based on the natural interplay between sorting and regular language theory. We will apply these findings inside practical tools for aligning arbitrarily-long DNA fragments against compressed pan-genome graphs.

Consortium (1)

Project Results (17)

Source: CORDIS, the EU research results database.

Publications (15)
A survey of BWT variants for string collections
Bioinformatics· 2024DOI
Cenzato, Davide; Lipták, Zsuzsanna
Computing the LCP Array of a Labeled Graph
Proceedings of the 35th Annual Symposium on Combinatorial Pattern Matching (CPM 2024)· 2024DOI
Jarno N. Alanko, Davide Cenzato, Nicola Cotumaccio, Sung-Hwan Kim, Giovanni Manzini, Nicola Prezza
Indexing Finite-State Automata Using Forward-Stable Partitions
Proceedings of the 31st International Symposium on String Processing and Information Retrieval (SPIRE 2024)· 2024DOI
Ruben Becker, Sung-Hwan Kim, Nicola Prezza, Carlo Tosoni
On Computing the Smallest Suffixient Set
Proceedings of the 31st International Symposium on String Processing and Information Retrieval (SPIRE 2024)· 2024DOI
Davide Cenzato, Francisco Olivares, Nicola Prezza
Random Wheeler Automata
Proceedings of the 35th Annual Symposium on Combinatorial Pattern Matching (CPM 2024)· 2024DOI
Ruben Becker, Davide Cenzato, Sung-Hwan Kim, Bojana Kodric, Riccardo Maso, Nicola Prezza
Sketching and Streaming for Dictionary Compression
Proceedings of the Data Compression Conference 2024· 2024DOI
Ruben Becker, Matteo Canton, Davide Cenzato, Sung-Hwan Kim, Bojana Kodric, Nicola Prezza
The Rational Construction of a Wheeler DFA
Proceedings of the 35th Annual Symposium on Combinatorial Pattern Matching (CPM 2024)· 2024DOI
Giovanni Manzini, Alberto Policriti, Nicola Prezza, Brian Riccardi
Top-k Frequent Patterns in Streams and Parameterized-Space LZ Compression
Proceedings of the 22nd International Symposium on Experimental Algorithms (SEA 2024)· 2024DOI
Patrick Dinklage, Johannes Fischer, Nicola Prezza
Co-lexicographically Ordering Automata and Regular Languages -- Part I
Journal of the ACM· 2023DOI
Nicola Cotumaccio; Giovanna D’Agostino; Alberto Policriti; Nicola Prezza
Computing matching statistics on Wheeler DFAs
Proceedings of the 2023 Data Compression Conference (DCC)· 2023DOI
Conte A.; Cotumaccio N.; Gagie T.; Manzini G.; Prezza N.; Sciortino M.
Faster Prefix-Sorting Algorithms for Deterministic Finite Automata
Proceedings of the 34th Annual Symposium on Combinatorial Pattern Matching (CPM 2023)· 2023DOI
Sung-Hwan Kim; Francisco Olivares; Nicola Prezza
Optimal Wheeler Language Recognition
Proceedings of String Processing and Information Retrieval 2023 ISBN: 9783031439797· 2023DOI
Ruben Becker; Davide Cenzato; Sung-Hwan Kim; Bojana Kodric; Alberto Policriti; Nicola Prezza
Sorting Finite Automata via Partition Refinement
Proceedings of the 31st Annual European Symposium on Algorithms (ESA 2023)· 2023DOI
Ruben Becker; Manuel Cáceres; Davide Cenzato; Sung-Hwan Kim; Bojana Kodric; Francisco Olivares; Nicola Prezza
Space-time Trade-offs for the LCP Array of Wheeler DFAs
Proceedings of String Processing and Information Retrieval 2023· 2023DOI
Nicola Cotumaccio, Travis Gagie, Dominik Köppl, Nicola Prezza
Toward a Definitive Compressibility Measure for Repetitive Sequences
IEEE Transactions on Information Theory· 2023DOI
Tomasz Kociumaka; Gonzalo Navarro; Nicola Prezza
Deliverables (1)
Documents, reports
Other Results (1)
Periodic Reporting for period 1 - REGINDEX (Compressed Indexes for Regular Languages with Applications to Computational Pan-genomics)