Tasks that ultimately require knowledge-based multimedia techniques (content-oriented search, assessment, abstracting, etc.) are still to a major extent carried out manually. PATExpert’s overall scientific goal is to change the paradigm currently followed for patent processing from textual (viewing patents as text blocks enriched by “canned” picture material, sequences of morpho-syntactic tokens, or collections of syntactic structures) to semantic (viewing patents as multimedia knowledge objects) processing. PATExpert developed a multimedia content representation formalism based on Semantic Web technologies for selected technology areas and investigate the retrieval, classification, multilingual generation of concise patent information, assessment and visualization of patent material encoded in this formalism, taking the information needs of all user types as defined in a user typology into account. PATExpert’s technological goal was to develop a showcase that demonstrates the viability of PATExpert’s approach to content representation for real applications. The composition and the competence of the Consortium ensured the achievement of these goals.
Our #PickOfTheWeek by @sarapapi: "RASST: Fast Cross-modal Retrieval-Augmented #Simultaneous #Speech #Translation" by Jiaxuan Luo, @siqi_ouyang, and @lileics (2026).
#RAG #SpeechTech
Very interesting new paper about combining Simultaneous Speech Translation and RAG to improve translation quality! Check it out: https://arxiv.org/pdf/2601.22777
#Speech #SpeechTech #Translation #RAG
Takeaway from our #2 DVPS consortium meeting: scaling with a few modalities won’t unlock the next leap. Progress we need to push in Europe now requires grounding intelligence in interaction and real-time feedback; we’re working on building the most promising MMFM architecture.
Oggi 11 febbraio è la Giornata Internazionale delle Donne e delle Ragazze nella Scienza.
Un’occasione per FBK di condividere e rilanciare il proprio impegno per l’uguaglianza di genere attraverso il Gender Equality Plan 2025-2028, recentemente approvato
https://magazine.fbk.eu/it/news/rinnovato-e-rafforzato-limpegno-verso-luguaglianza-di-genere-in-fbk/
🚀 𝗖𝗮𝗹𝗹 𝗳𝗼𝗿 𝗣𝗮𝗿𝘁𝗶𝗰𝗶𝗽𝗮𝘁𝗶𝗼𝗻: @iwslt Instruction Following 2026
Build general-purpose instruction-following speech models for 🌍 EN/DE/IT/ZH languages!
📅 Eval: 𝗔𝗽𝗿 1 | Submit: 𝗔𝗽𝗿 15
👉
#IWSLT2026 #SpeechAI #MultimodalAI