The scientific and technological objectives of QALL-ME pursued three crucial directions: multilingual open domain QA, user-driven and context-aware QA, and learning technologies for QA. The specific research objectives of the project included state-of-art advancements in the complexity of the questions handled by the system(e.g. how questions); the development of a web-based architecture for cross-language QA (i.e. question in one language, answer in a different language); the realization of real-time QA systems for concrete applications; the integration of the temporal and spatial context both for question interpretation and for answer extraction; the development of a robust framework for applying minimally supervised machine learning algorithms to QA tasks; and the integration of mature technologies for automatic speech recognition within the open domain question answering framework.
Our #PickOfTheWeek 📚: “High-Fidelity Simultaneous Speech-To-Speech Translation” by @t0m1ab, @lmazare, @EXGRV, @ptrkprz, @honualx and @neilzegh
🎙️➡️🌍 This work shows how a full-duplex SpeechLLM architecture can be adapted for simultaneous S2ST and S2TT.
Can LLM Agents Learn how to behave According to your preferences?
PersonaAgent is a framework that combines personalized memory and tool use to help LLM agents adapt their actions to individual users without fine-tuning the underlying model.
Our #PickOfTheWeek, selected by @mgaido91: "Alignment Is All You Need: Instruction-Free Training for General Audio-Language Models" by Xuanru Zhou, Yiwen Shao, Jiahong Li, and Dong Yu 🎧
Can instruction-free training power the next generation of audio-language models?
Cool to see we are not the only ones working on building SpeechLLMs with instruction-following capabilities without requiring LLM adaptation and instruction-following data that is expensive to collect!
https://arxiv.org/abs/2608.18132
@fbk_mt
Our #PickOfTheWeek, selected by @BeatriceSavoldi:
"The AI Observatory: A Public Measure of Real-World AI Use" by @ShayneRedford, @AnkaReuel, @zoeykii et al.
A crucial framework tracking how AI models are deployed, adopted, and evaluated beyond lab benchmarks.
Pick of the week @fbk_mt
📚"The AI Observatory: A Public Measure of Real-World AI Use"
A study and taxonomy to explore real conversations across multiple datasets.
https://www.dataprovenance.org/ai_observatory.pdf