Leveraging Non-Specialists for Accurate and Time Efficient AMR Annotation

Mary Martin, Cecilia Mauceri, Martha Palmer, Christoffer Heckman


Abstract
Abstract Meaning Representations (AMRs), a syntax-free representation of phrase semantics are useful for capturing the meaning of a phrase and reflecting the relationship between concepts that are referred to. However, annotating AMRs are time consuming and expensive. The existing annotation process requires expertly trained workers who have knowledge of an extensive set of guidelines for parsing phrases. In this paper, we propose a cost-saving two-step process for the creation of a corpus of AMR-phrase pairs for spatial referring expressions. The first step uses non-specialists to perform simple annotations that can be leveraged in the second step to accelerate the annotation performed by the experts. We hypothesize that our process will decrease the cost per annotation and improve consistency across annotators. Few corpora of spatial referring expressions exist and the resulting language resource will be valuable for referring expression comprehension and generation modeling.
Anthology ID:
2020.cllrd-1.5
Volume:
Proceedings of the LREC 2020 Workshop on "Citizen Linguistics in Language Resource Development"
Month:
May
Year:
2020
Address:
Marseille, France
Venues:
CLLRD | LREC | WS
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
35–39
Language:
English
URL:
https://www.aclweb.org/anthology/2020.cllrd-1.5
DOI:
Bib Export formats:
BibTeX MODS XML EndNote
PDF:
http://aclanthology.lst.uni-saarland.de/2020.cllrd-1.5.pdf