Publication Details
WTF-LOD - A New Resource for Large-Scale NER Evaluation
named entity evaluation, linked open data, CommonCrawl, ClueWeb, Wikipedia
This paper introduces the Web TextFull linkage to Linked Open Data (WTF-LOD) dataset intended for large-scale evaluation of named entity recognition (NER) systems. First, we present the process of collecting data from the largest publically-available textual corpora, including Wikipedia dumps, monthly runs of the CommonCrawl, and ClueWeb09/12. We discuss similarities and differences of related initiatives such as WikiLinks and WikiReverse. Our work primarily focuses on links from "textfull" documents (links surrounded by a text that provides a useful context for entity linking), de-duplication of the data and advanced cleaning procedures. Presented statistics demonstrate that the collected data forms one of the largest available resource of its kind. They also prove suitability of the result for complex NER evaluation campaigns, including an analysis of the most ambiguous name mentions appearing in the data.
@inproceedings{BUT130955,
author="Lubomír {Otrusina} and Pavel {Smrž}",
title="WTF-LOD - A New Resource for Large-Scale NER Evaluation",
booktitle="Proceedings of the Tenth conference on International Language Resources and Evaluation (LREC'16)",
year="2016",
pages="3299--3302",
publisher="European Language Resources Association",
address="Portorož",
isbn="978-2-9517408-9-1"
}