Clustering-Based Article Identification in Historical Newspapers

Martin Riedl, Daniela Betz, Sebastian Padó


Abstract
This article focuses on the problem of identifying articles and recovering their text from within and across newspaper pages when OCR just delivers one text file per page. We frame the task as a segmentation plus clustering step. Our results on a sample of 1912 New York Tribune magazine shows that performing the clustering based on similarities computed with word embeddings outperforms a similarity measure based on character n-grams and words. Furthermore, the automatic segmentation based on the text results in low scores, due to the low quality of some OCRed documents.
Anthology ID:
W19-2502
Volume:
Proceedings of the 3rd Joint SIGHUM Workshop on Computational Linguistics for Cultural Heritage, Social Sciences, Humanities and Literature
Month:
June
Year:
2019
Address:
Minneapolis, USA
Venues:
LaTeCH | NAACL | WS
SIG:
SIGHUM
Publisher:
Association for Computational Linguistics
Note:
Pages:
12–17
Language:
URL:
https://www.aclweb.org/anthology/W19-2502
DOI:
10.18653/v1/W19-2502
Bib Export formats:
BibTeX MODS XML EndNote
PDF:
http://aclanthology.lst.uni-saarland.de/W19-2502.pdf