de.datexis.nel.reader

Class WNEDDataset

java.lang.Object

de.datexis.nel.reader.WNEDDataset

public class WNEDDataset
extends Object

Reader for WNED Datasets: ACE2004, AIDA-CoNLL, AQUAINT, ClueWeb12, MSBNC, Wikipedia. From: Guo, Zhaochen, and Denilson Barbosa. "Robust named entity disambiguation with random walks." Semantic Web Preprint: 1-21. https://dataverse.library.ualberta.ca/dataset.xhtml?persistentId=doi:10.7939/DVN/10968

Author:

Robert Dziuba

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	WNEDDataset.Reader

Field Summary

Fields

Modifier and Type	Field and Description
protected List<Class<? extends Annotation>>	annotations Set of GOLD Annotations that should be appended to the Dataset.
protected static org.slf4j.Logger	log

Constructor Summary

Constructors

Constructor and Description
WNEDDataset()

Method Summary

Modifier and Type	Method and Description
Dataset	readDataSet(Resource xmlFile, Resource rawTextPath) Reads a WNED Dataset with NamedEntityAnnotations.
Dataset	readDataSet(Resource xmlFile, Resource rawTextPath, LuceneArticleIndex index)
protected List<Document>	readDocuments(Resource xmlFile, Resource rawTextPath)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

log

protected static final org.slf4j.Logger log

annotations

protected List<Class<? extends Annotation>> annotations

Set of GOLD Annotations that should be appended to the Dataset.

Constructor Detail

WNEDDataset

public WNEDDataset()

Method Detail

readDataSet

public Dataset readDataSet(Resource xmlFile,
                           Resource rawTextPath)
                    throws IOException

Reads a WNED Dataset with NamedEntityAnnotations.

Parameters:

xmlFile - - the XML containing the annotations

rawTextPath - - the folder containing raw text referenced in the XML

Returns:

Dataset with GOLD NamedEntityAnnotation and Wikipedia RefIDs (NOT Wikidata!)

Throws:

IOException

readDataSet

public Dataset readDataSet(Resource xmlFile,
                           Resource rawTextPath,
                           LuceneArticleIndex index)
                    throws IOException

Throws:

IOException

readDocuments

protected List<Document> readDocuments(Resource xmlFile,
                                       Resource rawTextPath)
                                throws IOException

Throws:

IOException