A decade of gender bias in machine translation
Beatrice Savoldi, Jasmijn Bastings, Luisa Bentivogli, Eva Vanmassenhove
An LLM-as-a-judge Approach for Scalable Gender-Neutral Translation Evaluation
Proceedings of the 3rd Workshop on Gender-Inclusive Translation Technologies (GITT 2025)· 2025
Andrea Piergentili, Beatrice Savoldi, Matteo Negri, Luisa Bentivogli
Cross-lingual Evaluation of Multilingual Text Generation
Proceedings of the 31st International Conference on Computational Linguistics· 2025
Shamil Chollampatt, Minh Quang Pham, Sathish Reddy Indurthi, Marco Turchi
Facial Attribute Based Text Guided Face Anonymization
Muştu, Mustafa İzzet; Ekenel, Hazım Kemal
Factorized-VITS: Decoupling Prosody and Text in End-to-End Speech Synthesis without External or Secondary Aligner
ICASSP 2025 - 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)· 2025DOI Yining Liu, Alexander Waibel
From Speech to Summary: A Comprehensive Survey of Speech Summarization
Retkowski, Fabian; Züfle, Maike; Sudmann, Andreas; Pfau, Dinah; Niehues, Jan; Waibel, Alexander
How “Real” is Your Real-Time Simultaneous Speech-to-Text Translation System?
Transactions of the Association for Computational Linguistics· 2025DOI Sara Papi, Peter Polák, Dominik Macháček, Ondřej Bojar
NUTSHELL: A Dataset for Abstract Generation from Scientific Talks
Proceedings of the 22nd International Conference on Spoken Language Translation (IWSLT 2025)· 2025DOI Maike Züfle, Sara Papi, Beatrice Savoldi, Marco Gaido, Luisa Bentivogli, Jan Niehues
Prepending or Cross-Attention for Speech-to-Text? An Empirical Comparison
Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)· 2025DOI Tsz Kin Lam, Marco Gaido, Sara Papi, Luisa Bentivogli, Barry Haddow
Speech Foundation Models and Crowdsourcing for Efficient, High-Quality Data Collection
Proceedings of the 31st International Conference on Computational Linguistics· 2025
Beomseok Lee, Marco Gaido, Ioan Calapodescu, Laurent Besacier, Matteo Negri
Decoupled Vocabulary Learning Enables Zero-Shot Translation from Unseen Languages
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)· 2024DOI Mullov, Carlos; Pham, Quan; Waibel, Alexander
Explainability for Speech Models: On the Challenges of Acoustic Feature Selection
Proceedings of the 10th Italian Conference on Computational Linguistics (CLiC-it 2024)· 2024
Dennis Fucci, Beatrice Savoldi, Marco Gaido, Matteo Negri, Mauro Cettolo, Luisa Bentivogli
FBK@IWSLT Test Suites Task: Gender Bias evaluation with MuST-SHE
Proceedings of the 21st International Conference on Spoken Language Translation (IWSLT 2024)· 2024DOI Beatrice Savoldi, Marco Gaido, Matteo Negri, Luisa Bentivogli
FINDINGS OF THE IWSLT 2024 EVALUATION CAMPAIGN
Proceedings of the 21st International Conference on Spoken Language Translation (IWSLT 2024)· 2024DOI Ibrahim Said Ahmad, Antonios Anastasopoulos, Ondřej Bojar, Claudia Borg, Marine Carpuat, Roldano Cattoni, Mauro Cettolo, William Chen, Qianqian Dong, Marcello Federico, Barry Haddow, Dávid Javorský, Mateusz Krubiński, Tsz Kim Lam, Xutai Ma, Prashant Mathur, Evgeny Matusov, Chandresh Maurya, John McCrae, Kenton Murray, Satoshi Nakamura, Matteo Negri, Jan Niehues, Xing Niu, Atul Kr. Ojha, John Ortega, Sara Papi, Peter Polák, Adam Pospíšil, Pavel Pecina, Elizabeth Salesky, Nivedita Sethiya, Balaram Sarkar, Jiatong Shi, Claytone Sikasote, Matthias Sperber, Sebastian Stüker, Katsuhito Sudoh, Brian Thompson, Alex Waibel, Shinji Watanabe, Patrick Wilken, Petr Zemánek, Rodolfo Zevallos
Findings of the Quality Estimation Shared Task at WMT 2024: Are LLMs Closing the Gap in QE?
Proceedings of the Ninth Conference on Machine Translation· 2024DOI Chrysoula Zerva, Frederic Blain, José G. C. De Souza, Diptesh Kanojia, Sourabh Deoghare, Nuno M. Guerreiro, Giuseppe Attanasio, Ricardo Rei, Constantin Orasan, Matteo Negri, Marco Turchi, Rajen Chatterjee, Pushpak Bhattacharyya, Markus Freitag, André Martins
GFG - Gender-Fair Generation: A CALAMITA Challenge
Proceedings of the 10th Italian Conference on Computational Linguistics (CLiC-it 2024)· 2024
Simona Frenda, Andrea Piergentili, Beatrice Savoldi, Marco Madeddu, Martina Rosola, Silvia Casola, Chiara Ferrando, Viviana Patti, Matteo Negri, Luisa Bentivogli
MAGNET - MAchines GeNErating Translations: A CALAMITA Challenge
Proceedings of the 10th Italian Conference on Computational Linguistics (CLiC-it 2024)· 2024
Mauro Cettolo, Andrea Piergentili, Sara Papi, Marco Gaido, Matteo Negri, Luisa Bentivogli
MOSEL: 950,000 Hours of Speech Data for Open-Source Speech Foundation Model Training on EU Languages
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing· 2024DOI Marco Gaido, Sara Papi, Luisa Bentivogli, Alessio Brutti, Mauro Cettolo, Roberto Gretter, Marco Matassoni, Mohamed Nabih, Matteo Negri
Optimizing Rare Word Accuracy in Direct Speech Translation with a Retrieval-and-Demonstration Approach
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing· 2024DOI Li, Siqi; Liu, Danni; Niehues, Jan
Quality Estimation with $k$-nearest Neighbors and Automatic Evaluation for Model-specific Quality Estimation
Dinh, Tu Anh; Palzer, Tobias; Niehues, Jan
SimulSeamless: FBK at IWSLT 2024 Simultaneous Speech Translation
Proceedings of the 21st International Conference on Spoken Language Translation (IWSLT 2024)· 2024DOI Sara Papi, Marco Gaido, Matteo Negri, Luisa Bentivogli
Speech Translation with Speech Foundation Models and Large Language Models: What is There and What is Missing?
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)· 2024DOI Marco Gaido, Sara Papi, Matteo Negri, Luisa Bentivogli
StreamAtt: Direct Streaming Speech-to-Text Translation with Attention-based Audio History Selection
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)· 2024DOI Sara Papi, Marco Gaido, Matteo Negri, Luisa Bentivogli
What the Harm? Quantifying the Tangible Impact of Gender Bias in Machine Translation with a Human-centered Study
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing· 2024DOI Beatrice Savoldi, Sara Papi, Matteo Negri, Ana Guerberof-Arenas, Luisa Bentivogli
A Bayesian Optimization Approach to Machine Translation Reranking
Julius Cheng, Maike Züfle, Vilém Zouhar, Andreas Vlachos
Analyzing the Feature Extractor Networks for Face Image Synthesis
Erdi Sarıtaş and Hazım Kemal Ekenel
Assessing the Use of Face Swapping Methods as Face Anonymizers in Videos
Mustafa İzzet Muştu, Hazım Kemal Ekenel
Audio-driven Talking Face Generation with Stabilized Synchronization Loss
Dogucan Yaman, Fevziye Irem Eyiokur, et al.
Audio-Visual Speech Representation Expert for Enhanced Talking Face Video Generation and Evaluation
Dogucan Yaman, Fevziye Irem Eyiokur, et al.
Blending LLMs into Cascaded Speech Translation: KIT's Offline Speech Translation System for IWSLT 2024
Sai Koneru, Thai-Binh Nguyen, Ngoc-Quan Pham, Danni Liu, Zhaolin Li, Alexander Waibel, Jan Niehues
Cocktail-Party Audio-Visual Speech Recognition
Thai-Binh Nguyen, Ngoc-Quan Pham, Alexander Waibel
Continuously Learning New Words in Automatic Speech Recognition
Christian Huber, Alexander Waibel
Contrastive Learning for Task-Independent SpeechLLM-Pretraining
Maike Züfle, Jan Niehues
Different Speech Translation Models Encode and Translate Speaker Gender Differently
Dennis Fucci, Marco Gaido, Matteo Negri, Luisa Bentivogli, André Martins, Giuseppe Attanasio
Early-Exit and Instant Confidence Translation Quality Estimation
Vilém Zouhar, Maike Züfle, Beni Egressy, Julius Cheng, Jan Niehues
FAMA: The First Large-Scale Open-Science Speech Foundation Model for Italian and English
Sara Papi*, Marco Gaido*, Luisa Bentivogli, Alessio Brutti, Mauro Cettolo, Roberto Gretter, Marco Matassoni, Mohamed Nabih, Matteo Negri.
Findings of the IWSLT 2025 Evaluation Campaign
Idris Abdulmumin, Victor Agostinelli, Tanel Alumäe, Antonios Anastasopoulos, Luisa Bentivogli, Ondřej Bojar, Claudia Borg, Fethi Bougares, Roldano Cattoni, Mauro Cettolo, Lizhong Chen, William Chen, Raj Dabre, Yannick Estève, Marcello Federico, Mark Fishe
How do Multimodal Foundation Models Encode Text and Speech? An Analysis of Cross-Lingual and Cross-Modal Representations
Hyunji Lee, Danni Liu, Supriti Sinhamahapatra, Jan Niehues
How to Connect Speech Foundation Models and Large Language Models? What Matters and What Does Not
Francesco Verdini, Pierfrancesco Melucci, Stefano Perna, Francesco Cariaggi, et al.
Impact of Face Alignment on Face Image Quality
Eren Onaran, Erdi Sarıtaş, Hazım Kemal Ekenel
KIT's Offline Speech Translation and Instruction Following Submission for IWSLT 2025
Sai Koneru*, Maike Züfle*, Thai-Binh Nguyen, Seymanur Akti, Jan Niehues, Alexander Waibel
MSA-ASR: Efficient Multilingual Speaker Attribution with frozen ASR Models
Thai-Binh Nguyen, Alexander Waibel
PIER: A Novel Metric for Evaluating What Matters in Code-Switching
Enes Yavuz Ugan, Ngoc-Quan Pham, Leonard Bärmann, and Alex Waibel
Recent Highlights in Multilingual and Multimodal Speech Translation
Danni Liu and Jan Niehues
Streaming Non-Autoregressive Model for Accent Conversion and Pronunciation Improvement
Tuan-Nam Nguyen, Ngoc-Quan Pham, Seymanur Akti, Alexander Waibel
The Warmup Dilemma: How Learning Rate Strategies Impact Speech-to-Text Model Convergence
Marco Gaido*, Sara Papi*, Luisa Bentivogli, Alessio Brutti, Mauro Cettolo, Roberto Gretter, Marco Matassoni, Mohamed Nabih, Matteo Negri.
Towards Better Disentanglement in Non-Autoregressive Zero-Shot Expressive Voice Conversion Voice Conversion
Seymanur Akti, Tuan Nam Nguyen, Alexander Waibel
Translation in the Hands of Many:Centering Lay Users in Machine Translation Interactions
Beatrice Savoldi, Alan Ramponi, Matteo Negri, Luisa Bentivogli.
Weight Factorization and Centralization for Continual Learning in Speech Recognition
Enes Yavuz Ugan*, Ngoc-Quan Pham*, Alexander Waibel