Detecting Offensive Tweets in Hindi-English Code-Switched Language

Puneet Mathur, Rajiv Shah, Ramit Sawhney, Debanjan Mahata


Abstract
The exponential rise of social media websites like Twitter, Facebook and Reddit in linguistically diverse geographical regions has led to hybridization of popular native languages with English in an effort to ease communication. The paper focuses on the classification of offensive tweets written in Hinglish language, which is a portmanteau of the Indic language Hindi with the Roman script. The paper introduces a novel tweet dataset, titled Hindi-English Offensive Tweet (HEOT) dataset, consisting of tweets in Hindi-English code switched language split into three classes: non-offensive, abusive and hate-speech. Further, we approach the problem of classification of the tweets in HEOT dataset using transfer learning wherein the proposed model employing Convolutional Neural Networks is pre-trained on tweets in English followed by retraining on Hinglish tweets.
Anthology ID:
W18-3504
Volume:
Proceedings of the Sixth International Workshop on Natural Language Processing for Social Media
Month:
July
Year:
2018
Address:
Melbourne, Australia
Venues:
ACL | SocialNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
18–26
Language:
URL:
https://www.aclweb.org/anthology/W18-3504
DOI:
10.18653/v1/W18-3504
Bib Export formats:
BibTeX MODS XML EndNote
PDF:
http://aclanthology.lst.uni-saarland.de/W18-3504.pdf