The project includes technology transfer activities from FBK-irst to Pervoice and development activities such as improvements of automatic transcription technology (rich transcription, automatic text polishing), speech analytics technologies for call centers (emotional state recognition, segmentation and classification of utterances, monitoring of transactions), and advanced acoustic normalization techniques.
Our #PickOfTheWeek 📚: “High-Fidelity Simultaneous Speech-To-Speech Translation” by @t0m1ab, @lmazare, @EXGRV, @ptrkprz, @honualx and @neilzegh
🎙️➡️🌍 This work shows how a full-duplex SpeechLLM architecture can be adapted for simultaneous S2ST and S2TT.
Can LLM Agents Learn how to behave According to your preferences?
PersonaAgent is a framework that combines personalized memory and tool use to help LLM agents adapt their actions to individual users without fine-tuning the underlying model.
Our #PickOfTheWeek, selected by @mgaido91: "Alignment Is All You Need: Instruction-Free Training for General Audio-Language Models" by Xuanru Zhou, Yiwen Shao, Jiahong Li, and Dong Yu 🎧
Can instruction-free training power the next generation of audio-language models?
Cool to see we are not the only ones working on building SpeechLLMs with instruction-following capabilities without requiring LLM adaptation and instruction-following data that is expensive to collect!
https://arxiv.org/abs/2608.18132
@fbk_mt
Our #PickOfTheWeek, selected by @BeatriceSavoldi:
"The AI Observatory: A Public Measure of Real-World AI Use" by @ShayneRedford, @AnkaReuel, @zoeykii et al.
A crucial framework tracking how AI models are deployed, adopted, and evaluated beyond lab benchmarks.
Pick of the week @fbk_mt
📚"The AI Observatory: A Public Measure of Real-World AI Use"
A study and taxonomy to explore real conversations across multiple datasets.
https://www.dataprovenance.org/ai_observatory.pdf