Luisa Bentivogli

Luisa Bentivogli heads the Machine Translation Group at Fondazione Bruno Kessler (FBK). From 2008 to 2013 she was assigned to the Centre for the Evaluation of Language and Communication Technologies (CELCT), first as Research Manager with the role of coordinating the activities of the centre (2008-2012), then as Director of the centre (2012-2013).

Her research interests include the evaluation and analysis of Machine Translation (MT) and Speech Translation (ST) systems, creation and annotation of multilingual resources, translation technologies for translators, crowdsourcing for natural language processing, and computational lexicography in a multilingual environment. Her current focus is on creating multilingual resources for speech translation (ST) and on assessing and mitigating gender bias in MT and ST, for which she recently won an Amazon Research Award.

Over the years, she has been involved in several EU-funded projects, including EuroSub (2021-2022), MateDUB++ (2021), MateDUB (2020), CEF Data Marketplace (2019-2021), EnetCollect (2017-2021), ModernMT (2015-2017), CRACKER (2015-2017), MosesCore (2012-2015), Excitement (2012-2014), EU-Bridge (2012-2014), MateCat (2011-2014), FlareNet (2008-2011), MEANING (2002-2005), in projects funded by the Autonomous Province of Trento, including LiveMemories (2008-2011), OntoText (2004-2007), WebFaq (2001-2004), and in job orders from private companies and public institutions (ongoing SmarTerp, TINIA).

She co-authored more than 90 scientific publications and serves as reviewer for journals, conferences and workshops. She regularly supervises internship, master, and PhD students. She has been involved in the organization of different tasks in several evaluation campaigns (e.g. IWSLT, RTE, SemEval, EVALITA) and other international events aimed at both the scientific community and translators (MT Marathon 2014, School of Advanced Technologies for Translators – SATT – 2016, 2017, 2018, 2019).

1. Vanmassenhove, Eva; Savoldi, Beatrice; Bentivogli, Luisa; Daems, Joke; Hackenbuckner, Janica,
   Proceedings of the First Workshop on Gender-Inclusive Translation Technologies,
   Proceedings of the First Workshop on Gender-Inclusive Translation Technologies,
   European Association for Machine Translation,
   2023
2. Piergentili, Andrea; Fucci, Dennis; Savoldi, Beatrice; Bentivogli, Luisa; Negri, Matteo,
   Gender Neutralization for an Inclusive Machine Translation: from Theoretical Foundations to Open Challenges,
   Proceedings of the First Workshop on Gender-Inclusive Translation Technologies,
   European Association for Machine Translation,
   2023
   , pp. 71-
   83
3. Agarwal, Milind; Agrawal, Sweta; Anastasopoulos, Antonios; Bentivogli, Luisa; Bojar, Ondřej; Borg, Claudia; Carpuat, Marine; Cattoni, Roldano; Cettolo, Mauro; Chen, Mingda; Chen, William; Choukri, Khalid; Chronopoulou, Alexandra; Currey, Anna; Declerck, Thierry; Dong, Qianqian; Duh, Kevin; Estève, Yannick; Federico, Marcello; Gahbiche, Souhir; Haddow, Barry; Hsu, Benjamin; Mon Htut, Phu; Inaguma, Hirofumi; Javorský, Dávid; Judge, John; Kano, Yasumasa; Ko, Tom; Kumar, Rishu; Li, Pengwei; Ma, Xutai; Mathur, Prashant; Matusov, Evgeny; Mcnamee, Paul; Mccrae, John P.; Murray, Kenton; Nadejde, Maria; Nakamura, Satoshi; Negri, Matteo; Nguyen, Ha; Niehues, Jan; Niu, Xing; Ojha, Atul Kr.; Ortega, John E.; Pal, Proyag; Pino, Juan; van der Plas, Lonneke; Polák, Peter; Rippeth, Elijah; Salesky, Elizabeth; Shi, Jiatong; Sperber, Matthias; Stüker, Sebastian; Sudoh, Katsuhito; Tang, Yun; Thompson, Brian; Tran, Kevin; Turchi, Marco; Waibel, Alex; Wang, Mingxuan; Watanabe, Shinji; Zevallos, Rodolfo,
   Findings of the IWSLT 2023 Evaluation Campaign.,
   Proceedings of the 20th International Conference on Spoken Language Translation (IWSLT 2023),
   Association for Computational Linguistics,
   2023
   , pp. 1-
   61
4. Piergentili, Andrea; Fucci, Dennis; Savoldi, Beatrice; Bentivogli, Luisa; Negri, Matteo,
   Gender Neutralization for an Inclusive Machine Translation: from Theoretical Foundations to Open Challenges,
   Proceedings of the First Workshop on Gender-Inclusive Translation Technologies (GITT 2023),
   European Association for Machine Translation,
   2023
   , pp. 71-
   83
5. Piergentili, Andrea; Fucci, Dennis; Savoldi, Beatrice; Negri, Matteo; Bentivogli, Luisa,
   Gender Neutralization for an Inclusive Machine Translation: from Theoretical Foundations to Open Challenges,
   Proceedings of the first Workshop on Gender-Inclusive Translation Technologies,
   2023
6. Savoldi, Beatrice; Gaido, Marco; Bentivogli, Luisa; Negri, Matteo; Turchi, Marco,
   Under the Morphosyntactic Lens: A Multifaceted Evaluation of Gender Bias in Speech Translation,
   in «»,
   Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers),
   Association for Computational Linguistics,
   vol. ,
   n. ,
   2022
   , pp. 1807-
   1824
7. Savoldi, Beatrice; Gaido, Marco; Bentivogli, Luisa; Negri, Matteo; Turchi, Marco,
   On the Dynamics of Gender Learning in Speech Translation,
   in «»,
   Proceedings of the 4th Workshop on Gender Bias in Natural Language Processing (GeBNLP),
   Association for Computational Linguistics,
   vol. ,
   n. ,
   2022
   , pp. 94-
   111
8. Anastasopoulos, Antonios; Barrault, Loc; Bentivogli, Luisa; Zanon Boito, Marcely; Bojar, Ondřej; Cattoni, Roldano; Currey, Anna; Dinu, Georgiana; Duh, Kevin; Elbayad, Maha; Emmanuel, Clara; Estève, Yannick; Federico, Marcello; Federmann, Christian; Gahbiche, Souhir; Gong, Hongyu; Grundkiewicz, Roman; Haddow, Barry; Hsu, Benjamin; Javorský, Dávid; Kloudová, Vĕra; Lakew, Surafel Melaku; Ma, Xutai; Mathur, Prashant; Mcnamee, Paul; Murray, Kenton; Nǎdejde, Maria; Nakamura, Satoshi; Negri, Matteo; Niehues, Jan; Niu, Xing; John, Ortega; Pino, Juan; Salesky, Elizabeth; Shi, Jiatong; Sperber, Matthias; Stüker, Sebastian; Sudoh, Katsuhito; Turchi, Marco; Virkar, Yogesh; Waibel, Alexander; Wang, Changhan; Watanabe, Shinji,
   Findings of the IWSLT 2022 Evaluation Campaign.,
   Proceedings of the 19th International Conference on Spoken Language Translation (IWSLT 2022),
   Association for Computational Linguistics,
   2022
   , pp. 98-
   157
9. Karakanta, Alina; Bentivogli, Luisa; Cettolo, Mauro; Negri, Matteo; Turchi, Marco,
   Towards a methodology for evaluating automatic subtitling,
   Proceedings of the 23rd Annual Conference of the European Association for Machine Translation,
   European Association for Machine Translation,
   2022
   , pp. 333-
   334
10. Bentivogli, Luisa; Cettolo, Mauro; Gaido, Marco; Karakanta, Alina; Negri, Matteo; Turchi, Marco,
    Extending the MuST-C Corpus for a Comparative Evaluation of Speech Translation Technology,
    Proceedings of the 23rd Annual Conference of the European Association for Machine Translation,
    European Association for Machine Translation,
    2022
    , pp. 359-
    360
11. Karakanta, Alina; Bentivogli, Luisa; Cettolo, Mauro; Negri, Matteo; Turchi, Marco,
    Post-editing in Automatic Subtitling: A Subtitlers’ perspective,
    Proceedings of the 23rd Annual Conference of the European Association for Machine Translation,
    European Association for Machine Translation,
    2022
    , pp. 259-
    268
12. Savoldi, Beatrice; Gaido, Marco; Bentivogli, Luisa; Negri, Marco; Turchi, Marco,
    Gender bias in machine translation,
    in «TRANSACTIONS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS»,
    ,
    ,
    vol. 9,
    n. ,
    2021
    , pp. 845-
    874
13. Savoldi, Beatrice; Bentivogli, Luisa,
    Gender bias and Machine Translation: On first looking into parallel corpora,
    Using Corpora in Contrastive and Translation Studies,
    2021
14. Gaido, Marco; Rodríguez, Susana; Negri, Matteo; Bentivogli, Luisa; Turchi, Marco,
    Is "moby dick" a Whale or a Bird? Named Entities and Terminology in Speech Translation,
    Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing,
    Association for Computational Linguistics,
    2021
    , pp. 1707-
    1716
15. Bentivogli, Luisa; Cettolo, Mauro; Gaido, Marco; Karakanta, Alina; Martinelli, Alberto; Negri, Matteo; Turchi, Marco,
    Cascade versus Direct Speech Translation: Do the Differences Still Make a Difference?,
    Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers),
    Association for Computational Linguistics,
    2021
    , pp. 2873-
    2887
16. Cattoni, Roldano; Di Gangi, Mattia Antonino; Bentivogli, Luisa; Negri, Matteo; Turchi, Marco,
    MuST-C: A multilingual corpus for end-to-end speech translation,
    in «COMPUTER SPEECH AND LANGUAGE»,
    vol. 66,
    2021
17. Gaido, Marco; Savoldi, Beatrice; Bentivogli, Luisa; Negri, Matteo; Turchi, Marco,
    How to Split: the Effect of Word Segmentation on Gender Bias in Speech Translation,
    in «»,
    Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021,
    Association for Computational Linguistics,
    vol. ,
    n. ,
    2021
    , pp. 3576-
    3589
18. Bentivogli, Luisa; Savoldi, Beatrice; Negri, Matteo; Di Gangi, Mattia Antonino; Cattoni, Roldano; Turchi, Marco,
    Gender in Danger? Evaluating Speech Translation Technology on the MuST-SHE Corpus,
    Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics,
    Association for Computational Linguistics,
    2020
    , pp. 6923-
    6933
19. Kamran, Amir; Dzeguze, Dace; van der Meer, Jaap; Panic, Milica; Cattelan, Alessandro; Patrioli, Daniele; Bentivogli, Luisa; Turchi, Marco,
    CEF Data Marketplace: Powering a Long-term Supply of Language Data,
    Proceedings of the 22nd Annual Conference of the European Association for Machine Translation,
    European Association for Machine Translation,
    2020
    , pp. 459-
    460
20. Gaido, Marco; Savoldi, Beatrice; Bentivogli, Luisa; Negri, Matteo; Turchi, Marco,
    Breeding Gender-aware Direct Speech Translation Systems,
    Proceedings of the 28th International Conference on Computational Linguistics,
    2020
    , pp. 3951-
    3964
21. Scansani, Randy; Bentivogli, Luisa; Bernardini, Silvia; Ferraresi, Adriano,
    MAGMATic: A Multi-domain Academic Gold Standard with Manual Annotation of Terminology for Machine Translation Evaluation,
    Proceedings of Machine Translation Summit XVII Volume 1: Research Track,
    vol. 1,
    2019
    , pp. 78-
    86
22. Scansani, Randy; Bernardini, Silvia; Ferraresi, Adriano; Bentivogli, Luisa,
    Do translator trainees trust machine translation? An experiment on post-editing and revision,
    Proceedings of Machine Translation Summit XVII Volume 2: Translator, Project and User Tracks,
    vol. 2,
    2019
    , pp. 73-
    79
23. Tebbifakhr, A.; Bentivogli, L.; Negri, M.; Turchi, M.,
    Machine Translation for Machines: the Sentiment Classification Use Case,
    Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing,
    2019
    , pp. 1368-
    1374
24. Di Gangi, Mattia A.; Cattoni, Roldano; Bentivogli, Luisa; Negri, Matteo; Turchi, Marco,
    MuST-C: a Multilingual Speech Translation Corpus,
    Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers),
    Association for Computational Linguistics,
    2019
    , pp. 2012-
    2017
25. Bentivogli, Luisa; Cettolo, Mauro; Federico, Marcello; Federmann, Christian,
    Machine Translation Human Evaluation: an investigation of evaluation based on Post-Editing and its relation with Direct Assessment,
    Proceedings of the 15th International Workshop on Spoken Language Translation (IWSLT 2018),
    2018
    , pp. 62-
    69
26. Bentivogli, Luisa; Bisazza, Arianna; Cettolo, Mauro; Federico, Marcello,
    Neural versus phrase-based MT quality: An in-depth analysis on English–German and English–French,
    in «COMPUTER SPEECH AND LANGUAGE»,
    vol. 49,
    2018
    , pp. 52-
    70
27. Nicolas, Lionel; Lyding, Verena; Bentivogli, Luisa; Sangati, Federico; Monti, Johanna; Russo, Irene; Gretter, Roberto; Falavigna, Giuseppe Daniele,
    EnetCollect in Italy,
    Proceedings of the Fifth Italian Conference on Computational Linguistics (CLiC-it 2018),
    CEUR Workshop Proceedings,
    vol. 2253,
    2018
28. Scansani, Randy; Federico, Marcello; Bentivogli, Luisa,
    Assessing the Use of Terminology in Phrase-Based Statistical Machine Translation for Academic Course Catalogues Translation,
    Proceedings of the Forth Italian Conference on Computational Linguistics (CLiC-it 2017),
    2017
29. Bentivogli, Luisa; Dagan, Ido Kalman; Magnini, Bernardo,
    The Recognizing Textual Entailment Challenges: Datasets and Methodologies,
    Handbook of Linguistic Annotation,
    Springer,
    2017
    , pp. 1119-
    1147
30. Cettolo, Mauro; Federico, Marcello; Bentivogli, Luisa; Niehues, Jan; Stüker, Sebastian; Sudoh, Katsuitho; Yoshino, Koichiro; Federmann, Christian,
    Overview of the IWSLT 2017 Evaluation Campaign,
    Proceedings of the 14th International Workshop on Spoken Language Translation,
    2017
    , pp. 2-
    14
31. Barbu, Eduard; Parra Escartin, Carla; Bentivogli, Luisa; Negri, Matteo; Turchi, Marco; Orasan, Constantin; Federico, Marcello,
    The first Automatic Translation Memory Cleaning Shared Task,
    in «MACHINE TRANSLATION»,
    vol. 30,
    n. 3,
    2016
    , pp. 145-
    166
32. Bentivogli, Luisa; Bernardi, Raffaella; Marelli, Marco; Menini, Stefano; Baroni, Marco; Zamparelli, Roberto,
    SICK through the SemEval glasses: Lessons learned from the evaluation of compositional distributional semantic models on full sentences through semantic relatedness and textual entailment,
    in «LANGUAGE RESOURCES AND EVALUATION»,
    vol. 50,
    n. 1,
    2016
    , pp. 95-
    124
33. Bentivogli, Luisa; Bertoldi, Nicola; Cettolo, Mauro; Federico, Marcello; Negri, Matteo; Turchi, Marco,
    On the Evaluation of Adaptive Machine Translation for Human Post-Editing,
    in «IEEE/ACM TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING»,
    vol. 24,
    n. 2,
    2016
    , pp. 388-
    399
34. Bentivogli, Luisa; Cettolo, Mauro; Farajian, Mohammad; Federico, Marcello,
    WAGS: A Beautiful English-Italian Benchmark Supporting Word Alignment Evaluation on Rare Words,
    Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016),
    European Language Resources Association (ELRA),
    2016
    , pp. 3535-
    3542
35. Bentivogli, Luisa; Bisazza, Arianna; Cettolo, Mauro; Federico, Marcello,
    Neural versus Phrase-Based Machine Translation Quality: a Case Study,
    Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP),
    Association for Computational Linguistics (ACL),
    2016
36. Germann, U.; Barbu, Eduard; Bentivogli, Luisa; Bertoldi, Nicola; Bogoychev, N.; Buck, Christian; Caroselli, D.; Carvalho, L.; Cattelan, A.; Cattoni, Roldano; Cettolo, Mauro; Federico, Marcello; Haddow, B.; Madl, D.; Mastrostefano, L.; Mathur, Prashant; Ruopp, A.; Samiotou, A.; Sudharshan, V.; Trombetti, M.; van der Meer, J.,
    Modern MT: A New Open-Source Machine Translation Platform for the Translation Industry,
    in «BALTIC JOURNAL OF MODERN COMPUTING»,
    vol. 4,
    n. 2,
    2016
    , pp. 397-
    397
37. Barbu, Eduard; Escartín, Carla Parra; Bentivogli, Luisa; Negri, Matteo; Turchi, Marco; Federico, Marcello; Mastrostefano, Luca; Orasan, Constantin,
    1st Shared Task on Automatic Translation Memory Cleaning: Preparation and Lessons Learned,
    Proceedings of the LREC 2016 2nd Workshop on Natural Language Processing for Translation Memories (NLP4TM 2016),
    2016
    , pp. 1-
    5
38. Bentivogli, Luisa; Federico, Marcello; Stüker, Sebastian; Cettolo, Mauro; Niehues, Jan,
    The IWSLT Evaluation Campaign: Challenges, Achievements, Future Directions,
    Proceedings of the LREC 2016 Workshop on Translation Evaluation: From Fragmented Tools and Data Sets to an Integrated Ecosystem,
    2016
    , pp. 14-
    19
39. Sprugnoli, Rachele; Moretti, Giovanni; Bentivogli, Luisa; Giuliani, Diego,
    Creating a ground truth multilingual dataset of news and talk show transcriptions through crowdsourcing,
    in «LANGUAGE RESOURCES AND EVALUATION»,
    2016
40. Cettolo, Mauro; Niehues, Jan; Stüker, Sebastian; Bentivogli, Luisa; Cattoni, Roldano; Federico, Marcello,
    The IWSLT 2016 Evaluation Campaign,
    Proceedings of the International Workshop on Spoken Language Translation,
    2016
41. Cettolo, Mauro; Niehues, Jan; Stüker, Sebastian; Bentivogli, Luisa; Cattoni, Roldano; Federico, Marcello,
    The IWSLT 2015 Evaluation Campaign,
    Proceedings of IWSLT,
    2015
42. Kotlerman, Lili; Dagan, Ido; Magnini, Bernardo; Bentivogli, Luisa,
    Textual entailment graphs,
    in «NATURAL LANGUAGE ENGINEERING»,
    vol. 21,
    n. 5,
    2015
    , pp. 699-
    724
43. Marelli, M.; Menini, Stefano; Baroni, M.; Bentivogli, Luisa; Bernardi, R.; Zamparelli, R.,
    A SICK cure for the evaluation of compositional distributional semantic models,
    Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14),
    2014
44. Bentivogli, Luisa; Magnini, Bernardo,
    An Italian dataset of Textual Entailment Graphs for text exploration of customer interactions,
    Proceedings of the First Italian Conference on Computational Linguistics CLiC-it 2014,
    2014
    , pp. 63-
    66
45. Girardi, Christian; Bentivogli, Luisa; Farajian, Mohammad Amin; Federico, Marcello,
    MT-EQuAl: a toolkit for human assessment of machine translation output,
    Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics,
    2014
    , pp. 120-
    123
46. Cettolo, Mauro; Niehues, J.; Stüker, S.; Bentivogli, Luisa; Federico, Marcello,
    Report on the 11th IWSLT Evaluation Campaign, IWSLT 2014,
    Proceedings of the International Workshop on Spoken Language Translation,
    Marcello Federico, Sebastian Stüker, François Yvon,
    2014
    , pp. 2-
    17
47. Marelli, M.; Bentivogli, Luisa; Baroni, M.; Bernardi, R.; Menini, Stefano; Zamparelli, R.,
    SemEval-2014 Task 1: Evaluation of compositional distributional semantic models on full sentences through semantic relatedness and textual entailment,
    Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014),
    2014
48. Federico, Marcello; Negri, Matteo; Bentivogli, Luisa; Turchi, Marco,
    Assessing the Impact of Translation Errors on Machine Translation Quality with Mixed-effects Models.,
    Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP),
    2014
    , pp. 1643-
    1653
49. Bentivogli, Luisa; Marchetti, A.; Pianta, Emanuele,
    The News People Search Task at EVALITA 2011: Evaluating Cross-Document Coreference Resolution of Named Person Entities in Italian News,
    Evaluation of Natural Language and Speech Tools for Italian - Proceedings of Evalita 2011,
    Springer-Verlag,
    2013
50. Negri, Matteo; Marchetti, A.; Mehdad, Yashar; Bentivogli, Luisa; Giampiccolo, Danilo,
    Semeval-2013 Task 8: Cross-lingual Textual Entailment for Content Synchronization,
    Proceedings of the Second Joint Conference on Lexical and Computational Semantics (*SEM), Volume 2: Proceedings of the Seventh International Workshop on Semantic Evaluation (SemEval 2013).,
    2013
    , pp. 25-
    33
51. Dzikovska, M.; Nielsen, R.; Brew, C.; Leacock, C.; Giampiccolo, Danilo; Bentivogli, Luisa; Clark, P.; Dagan, I.; Dang, H.,
    SemEval-2013 Task 7: The Joint Student Response Analysis and 8th Recognizing Textual Entailment Challenge,
    Second Joint Conference on Lexical and Computational Semantics (*SEM), Volume 2: Proceedings of the Seventh International Workshop on Semantic Evaluation (SemEval 2013),
    2013
52. Sprugnoli, Rachele; Moretti, Giovanni; Fuoli, M.; Giuliani, Diego; Bentivogli, Luisa; Pianta, Emanuele; Gretter, Roberto; Brugnara, Fabio,
    Comparing two methods for crowdsourcing speech transcription,
    Proceedings of ICASSP 2013,
    The Institute of Electrical and Electronics Engineers,Incorporated,
    2013
    , pp. 8116-
    8120
53. Cettolo, Mauro; J., Niehues; S., Stüker; Bentivogli, Luisa; Federico, Marcello,
    Report on the 10th IWSLT Evaluation Campaign,,
    Proceedings of the 10th Workshop on Spoken Language Translation,
    2013
54. Sprugnoli, Rachele; Moretti, Giovanni; Fuoli, M.; Bentivogli, Luisa; Pianta, Emanuele; Giuliani, Diego; Gretter, Roberto; Brugnara, Fabio,
    Uso del crowdsourcing per trascrizioni di alta qualità del linguaggio parlato: metodologie a confronto.,
    Multimodalità e Multilingualità. La sfida più avanzata della comunicazione orale,
    Bulzoni,
    2013
55. Bentivogli, Luisa; A., Marchetti; Pianta, Emanuele,
    The News People Search Task at EVALITA 2011: Evaluating Cross-document Coreference Resolution of Named Person Entities in Italian News,
    2012
56. Negri, Matteo; A., Marchetti; Mehdad, Yashar; Bentivogli, Luisa; Giampiccolo, Danilo,
    Semeval-2012 Task 8: Cross-lingual Textual Entailment for Content Synchronization.,
    Proceedings of the First Joint Conference on Lexical and Computational Semantics (*SEM),,
    Association for Computational Linguistics (ACL),
    2012
    , pp. 399-
    407
57. Negri, Matteo; Mehdad, Yashar; Giampiccolo, Danilo; A., Marchetti; Bentivogli, Luisa,
    Chinese Whispers: Cooperative Paraphrase Acquisition,
    Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12),
    European Language Resources Association (ELRA),
    2012
    , pp. 2659-
    2665
58. Federico, Marcello; S., Stüker; Bentivogli, Luisa; M., Paul; Cettolo, Mauro; T., Herrmann; J., Niehues; G., Moretti,
    The IWSLT 2011 Evaluation Campaign on Automatic Talk Translation,
    Proceedings of the International Conference on Language Resources and Evaluation (LREC),
    2012
    , pp. 3543-
    3550
59. M., Paul; E., Sumita; Bentivogli, Luisa; Federico, Marcello,
    Crowd-based MT Evaluation for non-English Target Languages,
    2012
    , pp. 229-
    236
60. Federico, Marcello; Cettolo, Mauro; Bentivogli, Luisa; Michael, Paul; Sebastian, Stüker,
    Overview of the IWSLT 2012 Evaluation Campaign,
    Proceedings of the International Workshop on Spoken Language Translation (IWSLT),
    2012
    , pp. 12-
    33
61. Negri, Matteo; Bentivogli, Luisa; Mehdad, Yashar; Giampiccolo, Danilo; Marchetti, Alessandro,
    Divide and Conquer: Crowdsourcing the Creation of Cross-Lingual Textual Entailment Corpora.,
    Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing,
    2011
    , pp. 670-
    679
62. Bentivogli, Luisa; Federico, Marcello; Moretti, Giovanni; M., Paul,
    Getting Expert Quality from the Crowd for Machine Translation Evaluation,
    2011
63. Bentivogli, Luisa; P., Clark; I., Dagan; H., Dang; D., Giampiccolo,
    The Seventh PASCAL Recognizing Textual Entailment Challenge,
    Proceedings of the Text Analysis Conference (TAC 2011),
    2011
64. Federico, Marcello; Bentivogli, Luisa; M., Paul; S., Stüker,
    Overview of the IWSLT 2011 Evaluation Campaign,
    2011
65. Bentivogli, Luisa; P., Clark; I., Dagan; H., Dang; D., Giampiccolo,
    The Sixth PASCAL Recognizing Textual Entailment Challenge,
    2010
66. A., Abad; Bentivogli, Luisa; Dagan, Ido Kalman; Giampiccolo, Danilo; S., Mirkin; Pianta, Emanuele; A., Stern,
    A Resource for Investigating the Impact of Anaphora and Coreference on Inference,
    Proceedings of the Language Resources and Evaluation Conference (LREC-2010),
    2010
    , pp. 128-
    135
67. Bentivogli, Luisa; Giuliano, Claudio; Pamela, Forner; Alessandro, Marchetti; Pianta, Emanuele; Tymoshenko, Kateryna,
    Extending English ACE 2005 Corpus Annotation with Ground-truth Links to Wikipedia,
    Proceedings of the 2nd Workshop on The People’s Web Meets NLP: Collaboratively Constructed Semantic Resources,
    2010
68. Bentivogli, Luisa; Cabrio, Elena; Dagan, Ido Kalman; Giampiccolo, Danilo; M., Lo Leggio; Magnini, Bernardo,
    Building Textual Entailment Specialized Data Sets: a Methodology for Isolating Linguistic Phenomena Relevant to Inference,
    Seventh conference on International Language Resources and Evaluation (LREC 2010),
    European Language Resources Association (ELRA),
    2010
    , pp. 3542-
    3549
69. Bentivogli, Luisa; Dagan, Ido Kalman; Hoa, Dang; Giampiccolo, Danilo; Magnini, Bernardo,
    The Fifth PASCAL Recognizing Textual Entailment Challenge,
    TAC 2009 Workshop,
    no publisher,
    2009
70. Bentivogli, Luisa; Dagan, Ido Kalman; Hoa, Dang; Giampiccolo, Danilo; Medea Lo, Leggio; Magnini, Bernardo,
    Considering Discourse References in Textual Entailment Annotation,
    5th International Conference on Generative Approaches to the Lexicon (GL 2009),
    2009
71. Bentivogli, Luisa; Girardi, Christian; Pianta, Emanuele,
    Creating a Gold Standard for Person Cross-Document Coreference Resolution in Italian News,
    LREC 2008 Workshop on Resources and Evaluation for Identity Matching, Entity Resolution and Entity Management,
    European Language Resources Association,
    2008
72. Bentivogli, Luisa; Pianta, Emanuele,
    Linee guida per la creazione del Gold Standard per la risoluzione della coreferenza di entità di tipo PERSONA in Adige-500K,
    2007
73. Bentivogli, Luisa; Fioravanti, Anna; Fontanive, Patrizia; Pianta, Emanuele; Speranza, Manuela,
    Linee guida per la creazione della Scheda Ontologica e per l´annotazione della coreferenza globale delle entità presenti in I-CAB,
    2007
74. Bentivogli, Luisa; Magnini, Bernardo,
    ONTOTEXT Portal (Version 31 December 2006): Functional Specifications,
    2006
75. Pianta, Emanuele; Bentivogli, Luisa; Girardi, Christian; Magnini, Bernardo,
    Representing and Accessing Multilevel Linguistic Annotation using the MEANING Format,
    EACL-06 Workshop on Multi-dimensional Markup in Natural Language Processing (NLPXML-2006),
    ACL,
    2006
    , pp. 77-
    80
76. Bentivogli, Luisa; Magnini, Bernardo,
    Accesso all´informazione basato su conoscenza: interfaccia del portale ONTOTEXT (versione 31/12/2006),
    2006
77. Bentivogli, Luisa; Pianta, Emanuele,
    Exploiting parallel texts in the creation of multilingual semantically annotated resources: the MultiSemCor Corpus,
    in «NATURAL LANGUAGE ENGINEERING»,
    Cambridge University Press,
    vol. 11,
    n. 3,
    2005
    , pp. 247-
    261
78. Bentivogli, Luisa; P., Forner; Pianta, Emanuele,
    Evaluating Cross-Language Annotation Transfer in the MultiSemCor Corpus,
    20th International Conference on Computational Linguistics [COLING 2004],
    ACL,
    2004
    , pp. 364-
    370
79. Bentivogli, Luisa; P., Forner; Magnini, Bernardo; Pianta, Emanuele,
    Revising the WORDNET DOMAINS Hierarchy: semantics, coverage and balancing,
    MLR2004: PostCOLING Workshop on Multilingual Linguistic Resources,
    2004
    , pp. 101-
    108
80. Pianta, Emanuele; Bentivogli, Luisa,
    Knowledge Intensive Word Alignment with KNOWA,
    20th International Conference on Computational Linguistics [COLING 2004],
    ACL,
    2004
    , pp. 1086-
    1092
81. Pianta, Emanuele; Bentivogli, Luisa,
    Annotating Discontinuous Structures in XML: the Multiword Case,
    LREC 2004 Satellite Workshop on XML-based richly annotated corpora,
    2004
    , pp. 30-
    37
82. M., Ranieri; Pianta, Emanuele; Bentivogli, Luisa,
    Browsing Multilingual Information with the MultiSemCor Web Interface,
    LREC 2004 Workshop on `The Amazing Utility of Parallel and Comparable Corpora`,
    European Language Resources Association,
    2004
    , pp. 38-
    41
83. Bentivogli, Luisa; Pianta, Emanuele,
    Extending WordNet with Syntagmatic Information,
    Second International WordNet Conference [GWC 2004],
    Masaryk University,
    2004
    , pp. 47-
    53
84. Bentivogli, Luisa; A., Bocco; Pianta, Emanuele,
    ArchiWordNet: Integrating WordNet with Domain-Specific Knowledge,
    Second International WordNet Conference [GWC 2004],
    Masaryk University,
    2004
    , pp. 39-
    46
85. Bentivogli, Luisa; Pianta, Emanuele,
    Beyond Lexical Units: Enriching WordNets with Phrasets,
    10th Conference of the European Chapter of the Association for Computational Linguistics (EACL`03),
    ACL,
    2003
    , pp. 67-
    70
86. Bentivogli, Luisa; Girardi, Christian; Pianta, Emanuele,
    The MEANING Italian Corpus,
    Corpus Linguistics 2003 Conference,
    2003
    , pp. 103-
    112
87. Pianta, Emanuele; Bentivogli, Luisa,
    Annotating Discontinuous Structures in XML: the Multiword Case,
    2003
88. Pianta, Emanuele; Bentivogli, Luisa,
    Translation as Annotation,
    AI*IA 2003 Workshop `Topics and Perspectives of Natural Language Processing in Italy`,
    2003
    , pp. 40-
    48
89. Bentivogli, Luisa; Girardi, Christian,
    The MEANING Italian Corpus,
    2002
90. Bentivogli, Luisa; Pianta, Emanuele,
    Beyond Lexical Units: Enriching WordNets with Phrasets,
    2002
91. Bentivogli, Luisa; Girardi, Christian; Giuliano, Claudio; Pianta, Emanuele,
    The MEANING Italian Corpus,
    2002
92. Bentivogli, Luisa; Pianta, Emanuele,
    Detecting hidden multiwords in bilingual dictionaries,
    Tenth EURALEX International Congress [EURALEX-2002],
    2002
    , pp. 785-
    793
93. Bentivogli, Luisa; Pianta, Emanuele,
    Opportunistic Semantic Tagging,
    Third International Conference on Language Resources and Evaluation (LREC 2002),
    2002
    , pp. 1401-
    1406
94. Pianta, Emanuele; Bentivogli, Luisa; Girardi, Christian,
    MultiWordNet: developing an aligned multilingual database,
    First International Conference on Global WordNet,
    2002
    , pp. 293-
    302
95. Bentivogli, Luisa; Forner, Pamela; Pianta, Emanuele,
    Manual word alignment guidelines for the MultiSemCor project,
    2001
96. Bentivogli, Luisa; Pianesi, Fabio; Pianta, Emanuele,
    PhiloNet: creating semantic concordances for the analysis of philosophical texts,
    2001 Joint International Conference of the Association for Computers and the Humanities and the Association for Literary and Linguistic Computing (ACH/ALLC 2001),
    2001
    , pp. 139-
    141
97. Bentivogli, Luisa; Pianta, Emanuele,
    Looking for Lexical Gaps,
    Ninth EURALEX International Congress [EURALEX 2000],
    2000
    , pp. 663-
    669
98. Bentivogli, Luisa; Pianesi, Fabio; Pianta, Emanuele,
    From Word-based to Concept-based Text Analysis: the PhiloNet Project,
    Workshop Informatica umanistica: filosofia e risorse digitali,
    2000
99. Bentivogli, Luisa; Pianta, Emanuele; Pianesi, Fabio,
    Coping with Lexical Gaps when Building Aligned Multilingual Wordnets,
    Second International Conference on Language Resources and Evaluation (LREC 2000),
    2000
    , pp. 993-
    997
100. Bentivogli, Luisa,
     Relazioni lessicali e semantiche nella costruzione di un lessico computazionale multilingue: Problematiche Tecniche e Filosofiche,
     1999