Learning from disagreement: A survey AN Uma, T Fornaciari, D Hovy, S Paun, B Plank, M Poesio Journal of Artificial Intelligence Research 72, 1385-1470, 2021 | 186 | 2021 |
We need to consider disagreement in evaluation V Basile, M Fell, T Fornaciari, D Hovy, S Paun, B Plank, M Poesio, A Uma Proceedings of the 1st workshop on benchmarking: past, present and future, 15-21, 2021 | 121 | 2021 |
Beyond black & white: Leveraging annotator disagreement via soft-label multi-task learning T Fornaciari, A Uma, S Paun, B Plank, D Hovy, M Poesio Proceedings of the 2021 Conference of the North American Chapter of the …, 2021 | 116 | 2021 |
Anaphora resolution with the ARRAU corpus M Poesio, Y Grishina, V Kolhatkar, NS Moosavi, I Roesiger, A Roussel, ... Proceedings of the First Workshop on Computational Models of Reference …, 2018 | 65 | 2018 |
SemEval-2021 task 12: Learning with disagreements A Uma, T Fornaciari, A Dumitrache, T Miller, J Chamberlain, B Plank, ... Proceedings of the 15th International Workshop on Semantic Evaluation …, 2021 | 61 | 2021 |
A crowdsourced corpus of multiple judgments and disagreement on anaphoric interpretation M Poesio, J Chamberlain, S Paun, J Yu, A Uma, U Kruschwitz Proceedings of the 2019 Conference of the North American Chapter of the …, 2019 | 61 | 2019 |
A case for soft loss functions A Uma, T Fornaciari, D Hovy, S Paun, B Plank, M Poesio Proceedings of the AAAI Conference on Human Computation and Crowdsourcing 8 …, 2020 | 56 | 2020 |
SemEval-2023 task 11: Learning with disagreements (LeWiDi) E Leonardelli, A Uma, G Abercrombie, D Almanea, V Basile, T Fornaciari, ... arXiv preprint arXiv:2304.14803, 2023 | 46 | 2023 |
A cluster ranking model for full anaphora resolution J Yu, A Uma, M Poesio arXiv preprint arXiv:1911.09532, 2019 | 24 | 2019 |
Scaling and disagreements: Bias, noise, and ambiguity A Uma, D Almanea, M Poesio Frontiers in Artificial Intelligence 5, 818451, 2022 | 23 | 2022 |
Hard and soft evaluation of NLP models with BOOtSTrap SAmpling-BooStSa T Fornaciari, A Uma, M Poesio, D Hovy Proceedings of the 60th Annual Meeting of the Association for Computational …, 2022 | 9 | 2022 |
Soft metrics for evaluation with disagreements: an assessment G Rizzi, E Leonardelli, M Poesio, A Uma, M Pavlovic, S Paun, P Rosso, ... Proceedings of the 3rd Workshop on Perspectivist Approaches to NLP …, 2024 | 1 | 2024 |
Comparing methods for extractive summarization of call centre dialogue AN Uma, D Sityaev arXiv preprint arXiv:2209.02472, 2022 | 1 | 2022 |
LREC 2022 Workshop Language Resources and Evaluation Conference 20th June 2022 G Abercrombie, V Basile, S Tonelli, V Rieser, A Uma | | 2022 |
Proceedings of the 1st Workshop on Perspectivist Approaches to NLP@ LREC2022 G Abercrombie, V Basile, S Tonelli, V Rieser, A Uma Proceedings of the 1st Workshop on Perspectivist Approaches to NLP@ LREC2022, 2022 | | 2022 |
Making the Most of Crowd Information: Learning and Evaluation in AI tasks with Disagreements AN Uma Queen Mary University of London, 2021 | | 2021 |
Using Online Games to Collect Data about Disagreements M Poesio, J Chamberlain, U Kruschwitz, S Paun, A Uma | | 2018 |