User-centered & Robust NLP OSS: Lessons Learned from Developing & Maintaining RSMTool

Nitin Madnani, Anastassia Loukina


Abstract
For the last 5 years, we have developed and maintained RSMTool – an open-source tool for evaluating NLP systems that automatically score written and spoken responses. RSMTool is designed to be cross-disciplinary, borrowing heavily from NLP, machine learning, and educational measurement. Its cross-disciplinary nature has required us to learn a user-centered development approach in terms of both design and implementation. We share some of these lessons in this paper.
Anthology ID:
2020.nlposs-1.20
Volume:
Proceedings of Second Workshop for NLP Open Source Software (NLP-OSS)
Month:
November
Year:
2020
Address:
Online
Venues:
EMNLP | NLPOSS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
141–146
Language:
URL:
https://www.aclweb.org/anthology/2020.nlposs-1.20
DOI:
10.18653/v1/2020.nlposs-1.20
Bib Export formats:
BibTeX MODS XML EndNote
PDF:
http://aclanthology.lst.uni-saarland.de/2020.nlposs-1.20.pdf