Modeling Missing Data in Distant Supervision for Information Extraction

Alan Ritter, Luke Zettlemoyer, Mausam, Oren Etzioni


Abstract
Distant supervision algorithms learn information extraction models given only large readily available databases and text collections. Most previous work has used heuristics for generating labeled data, for example assuming that facts not contained in the database are not mentioned in the text, and facts in the database must be mentioned at least once. In this paper, we propose a new latent-variable approach that models missing data. This provides a natural way to incorporate side information, for instance modeling the intuition that text will often mention rare entities which are likely to be missing in the database. Despite the added complexity introduced by reasoning about missing data, we demonstrate that a carefully designed local search approach to inference is very accurate and scales to large datasets. Experiments demonstrate improved performance for binary and unary relation extraction when compared to learning with heuristic labels, including on average a 27% increase in area under the precision recall curve in the binary case.
Anthology ID:
Q13-1030
Volume:
Transactions of the Association for Computational Linguistics, Volume 1
Month:
Year:
2013
Address:
Venue:
TACL
SIG:
Publisher:
Note:
Pages:
367–378
Language:
URL:
https://www.aclweb.org/anthology/Q13-1030
DOI:
10.1162/tacl_a_00234
Bib Export formats:
BibTeX MODS XML EndNote
PDF:
http://aclanthology.lst.uni-saarland.de/Q13-1030.pdf