The MT Group is pleased to announce a fully funded PhD position in Human-centred Evaluation Frameworks for Multilingual Technologies.
Description of the PhD position
The PhD student will work on the topic of Human-centred Evaluation for Multilingual Technologies. The full description of the position is the following:
How we measure and define performance shapes the systems we build. Current Natural Language Processing (NLP) benchmarks often prioritize leaderboard scores over practical utility, failing to capture how models behave in real-world, socially situated contexts. This PhD project treats evaluation methodology as a research problem in its own right, advancing both the conceptual foundations and computational tools for assessing NLP systems in ways that are reliable, valid, and human-centred. Application domains include multilingual settings, such as machine translation, and emerging agentic and interactive multimodal NLP systems involving human-AI collaboration present frontier evaluation challenges. The ultimate goal is to develop evaluation frameworks that capture not only overall system performance, but also real-world utility, fairness, and responsiveness to the needs of diverse stakeholders.
When filling out the online application form, applicants must select scholarship “A9 – Human-centred Evaluation Frameworks for Multilingual Technologies”
More info about this specific PhD position are in this page.
How to apply?
All the details about the application process can be found on the University of Trento website.
Deadline
The application must be completed and submitted exclusively via the online system by August 27 at 4:00 pm CEST.
It is strongly recommended that you do not wait until the last few days before the deadline to submit your application.
Contact
If you are interested, you can contact Matteo Negri (negri@fbk.eu)
