Corpora

mGeNTE

by Beatrice Savoldi | Jan 13, 2025 | Corpora | 0

mGeNTE (Multilingual Gender-Neutral Translation Evaluation) is a natural, multilingual corpus designed to benchmark gender-neutral language and automatic translation.mGente is built upon European Parliament speech data extracted...

MOSEL

by Sara Papi | Oct 31, 2024 | Corpora | 0

The MOSEL corpus is a multilingual dataset collection including up to 950K hours of open-source speech recordings covering the 24 official languages of the European Union. We collect data by surveying labeled and unlabeled...

Speech-MASSIVE

by Beomseok Lee | Aug 21, 2024 | Corpora | 0

Spoken Language Understanding (SLU) involves interpreting spoken input using Natural Language Processing (NLP). Voice assistants like Alexa and Siri are real-world examples of SLU applications. The core tasks in SLU include...

WAGS

by Mauro Cettolo | Apr 30, 2024 | Corpora | 0

Ready-to-use version for MT research purposes of the multilingual transcriptions of TED talks

GenderCrawl

by Dennis Fucci | Oct 20, 2023 | Corpora | 0

Text corpora for Spanish, French, and Italian containing gendered words referring to the first-person speaker

INES

by Beatrice Savoldi | Oct 19, 2023 | Corpora | 1

The INclusive Evaluation Suite (INES) is a test set designed to assess MT systems ability to produce gender-inclusive translations for the German→English language pair. By design, each German source sentence in INES includes an...

GeNTE

by Beatrice Savoldi | Oct 9, 2023 | Corpora | 0

GeNTE (Gender-Neutral Translation Evaluation) is a natural, bilingual corpus designed to benchmark the ability of machine translation systems to generate gender-neutral translations. Built from European Parliament speeches,...

EC Short Clips

by Marco Gaido | Jul 7, 2023 | Corpora | 0

EC Short Clips is a test set dedicated to evaluate automatic subtitling systems.

EuroParl Interviews

by Marco Gaido | Jul 7, 2023 | Corpora | 0

EuroParl Interviews is a test set dedicated to evaluate automatic subtitling systems.

NEuRoparl-ST

by Matteo Negri | Jun 1, 2023 | Corpora | 0

Multilingual benchmark built from European Parliament speeches and annotated with Named Entities and Terminology

Heroes-ON-OFF

by Mauro Cettolo | May 30, 2023 | Corpora | 0

Annotation of dubbing segments based on the Heroes corpus

TOSCA-MP SPEECH GROUND TRUTH

by Beatrice Savoldi | May 30, 2023 | Corpora | 0

This multilingual dataset was created within the TOSCA-MP project as ground truth data for the evaluation of automatic transcription and spoken language translation technologies.

MT Group at FBK Follow

#MachineTranslation Research Unit @FBK_research. #nlproc #deeplearning #ai

Avatar MT Group at FBK @fbk_mt ·

11 Jun

Our pick of the week by @beomseok_lee_: "ALAS: Measuring Latent Speech-Text Alignment For Spoken Language Understanding In Multimodal LLMs" by Pooneh Mousavi, @yingzhi_wang, @mirco_ravanelli, and @CemSubakan (2025)

#SLU #speech #multimodal #LLM

Beomseok LEE @beomseok_lee_

Speech-language models show promise in multimodal tasks—but how well are speech & text actually aligned? 🤔

This paper https://arxiv.org/abs/2505.19937 proposes a new metric to measure layer-wise correlation between the two, with a focus on SLU tasks. 🔍🗣️📄

Reply on Twitter 1932717374731661474 Retweet on Twitter 1932717374731661474 1 Like on Twitter 1932717374731661474 Twitter 1932717374731661474

Retweet on Twitter MT Group at FBK Retweeted

Avatar BeatriceSavoldi @beatricesavoldi ·

6 Jun

🔍 Ciao! Stiamo studiando come l'AI viene usata in Italia e per farlo abbiamo costruito un sondaggio!

👉https://bocconi.eu.qualtrics.com/jfe/form/SV_2nTelXaXvJlinbg (è anonimo, dura ~10 m, se partecipi o lo diffondi ci aiuti un sacco🙏)

Ci interessa anche raggiungere persone che non si occupano di AI!

Reply on Twitter 1930976826257510858 Retweet on Twitter 1930976826257510858 12 Like on Twitter 1930976826257510858 13 Twitter 1930976826257510858

Avatar MT Group at FBK @fbk_mt ·

4 Jun

Our pick of the week by @apierg: "Agree to Disagree? A Meta-Evaluation of LLM Misgendering" by Arjun Subramonian, Vagrant Gautam, Preethi Seshadri, Dietrich Klakow, @kaiwei_chang, @YizhouSun (2025).

#LLM #misgendering #gender

Andrea Piergentili @apierg

Super interesting paper by Subramonian et al: "Agree to Disagree? A Meta-Evaluation of LLM Misgendering" https://arxiv.org/abs/2504.17075
Turns out, misgendering is messier than just pronouns. I'd love to see this analysis extended to grammatical gender languages! #LLM #AI #ethics @fbk_mt

Reply on Twitter 1930267432783851747 Retweet on Twitter 1930267432783851747 Like on Twitter 1930267432783851747 3 Twitter 1930267432783851747

Retweet on Twitter MT Group at FBK Retweeted

Avatar Sara Papi @sarapapi ·

30 May

🚀 New tech report out! Meet FAMA, our open-science speech foundation model family for both ASR and ST in 🇬🇧 English and 🇮🇹 Italian.

The models are live and ready to try on @huggingface 👇
🔗

#ASR #ST #OpenScience #MultilingualAI

Reply on Twitter 1928375820650684427 Retweet on Twitter 1928375820650684427 10 Like on Twitter 1928375820650684427 26 Twitter 1928375820650684427