The risk of sub-optimal use of Open Source NLP Software: UKB is inadvertently state-of-the-art in knowledge-based WSD

Eneko Agirre, Oier López de Lacalle, Aitor Soroa


Abstract
UKB is an open source collection of programs for performing, among other tasks, Knowledge-Based Word Sense Disambiguation (WSD). Since it was released in 2009 it has been often used out-of-the-box in sub-optimal settings. We show that nine years later it is the state-of-the-art on knowledge-based WSD. This case shows the pitfalls of releasing open source NLP software without optimal default settings and precise instructions for reproducibility.
Anthology ID:
W18-2505
Volume:
Proceedings of Workshop for NLP Open Source Software (NLP-OSS)
Month:
July
Year:
2018
Address:
Melbourne, Australia
Venues:
ACL | NLPOSS | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
29–33
Language:
URL:
https://www.aclweb.org/anthology/W18-2505
DOI:
10.18653/v1/W18-2505
Bib Export formats:
BibTeX MODS XML EndNote
PDF:
http://aclanthology.lst.uni-saarland.de/W18-2505.pdf