DSNDM: Deep Siamese Neural Discourse Model with Attention for Text Pairs Categorization and Ranking

Alexander Chernyavskiy, Dmitry Ilvovsky


Abstract
In this paper, the utility and advantages of the discourse analysis for text pairs categorization and ranking are investigated. We consider two tasks in which discourse structure seems useful and important: automatic verification of political statements, and ranking in question answering systems. We propose a neural network based approach to learn the match between pairs of discourse tree structures. To this end, the neural TreeLSTM model is modified to effectively encode discourse trees and DSNDM model based on it is suggested to analyze pairs of texts. In addition, the integration of the attention mechanism in the model is proposed. Moreover, different ranking approaches are investigated for the second task. In the paper, the comparison with state-of-the-art methods is given. Experiments illustrate that combination of neural networks and discourse structure in DSNDM is effective since it reaches top results in the assigned tasks. The evaluation also demonstrates that discourse analysis improves quality for the processing of longer texts.
Anthology ID:
2020.codi-1.8
Volume:
Proceedings of the First Workshop on Computational Approaches to Discourse
Month:
November
Year:
2020
Address:
Online
Venues:
CODI | EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
76–85
Language:
URL:
https://www.aclweb.org/anthology/2020.codi-1.8
DOI:
10.18653/v1/2020.codi-1.8
Bib Export formats:
BibTeX MODS XML EndNote
PDF:
http://aclanthology.lst.uni-saarland.de/2020.codi-1.8.pdf