Building an annotated dataset of app store reviews with Appraisal features in English and Spanish

Natalia Mora, Julia Lavid-López


Abstract
This paper describes the creation and annotation of a dataset consisting of 250 English and Spanish app store reviews from Google’s Play Store with Appraisal features. This is one of the most influential linguistic frameworks for the analysis of evaluation and opinion in discourse due to its insightful descriptive features. However, it has not been extensively applied in NLP in spite of its potential for the classification of the subjective content of these reviews. We describe the dataset, the annotation scheme and guidelines, the agreement studies, the annotation results and their impact on the characterisation of this genre.
Anthology ID:
W18-1103
Volume:
Proceedings of the Second Workshop on Computational Modeling of People’s Opinions, Personality, and Emotions in Social Media
Month:
June
Year:
2018
Address:
New Orleans, Louisiana, USA
Venues:
NAACL | PEOPLES | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
16–24
Language:
URL:
https://www.aclweb.org/anthology/W18-1103
DOI:
10.18653/v1/W18-1103
Bib Export formats:
BibTeX MODS XML EndNote
PDF:
http://aclanthology.lst.uni-saarland.de/W18-1103.pdf