de.datexis.sector.reader

Class ChoiDatasetReader

java.lang.Object

de.datexis.reader.DirectoryDatasetReader<RawTextDatasetReader>

de.datexis.reader.RawTextDatasetReader

de.datexis.sector.reader.ChoiDatasetReader

All Implemented Interfaces:

DatasetReader

public class ChoiDatasetReader
extends RawTextDatasetReader

Reader for Text Segmentation datasets by Freddy Choi (2000) "Advances in domain independent linear text segmentation". In Proceedings of NAACL'00. https://github.com/logological/C99

Author:

Sebastian Arnold

Field Summary

Fields

Modifier and Type	Field and Description
protected static org.slf4j.Logger	log
protected static String	SEGMENT_SPLIT

Fields inherited from class de.datexis.reader.RawTextDatasetReader

generateUIDs, isTokenized, useFirstSentenceAsTitle

Fields inherited from class de.datexis.reader.DirectoryDatasetReader

limit, randomizeDocuments

Constructor Summary

Constructors

Constructor and Description
ChoiDatasetReader()

Method Summary

Modifier and Type	Method and Description
static void	readC99Result(Dataset dataset, Resource path) Read .ref/.pred files produced by C99.
Document	readDocumentFromFile(Resource file) Read a single Document from file.

Methods inherited from class de.datexis.reader.RawTextDatasetReader

withFirstSentenceAsTitle, withGeneratedUIDs, withTokenizedInput

Methods inherited from class de.datexis.reader.DirectoryDatasetReader

read, readDatasetFromDirectory, readDatasetFromDirectory, stream, streamDocumentsFromDirectory, tryReadDocumentsFromFile, withLimitNumberOfDocuments, withRandomizedDocuments

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

log

protected static final org.slf4j.Logger log

SEGMENT_SPLIT

protected static final String SEGMENT_SPLIT

See Also:

Constant Field Values

Constructor Detail

ChoiDatasetReader

public ChoiDatasetReader()

Method Detail

readDocumentFromFile

public Document readDocumentFromFile(Resource file)

Read a single Document from file.

Overrides:

readDocumentFromFile in class RawTextDatasetReader

readC99Result

public static void readC99Result(Dataset dataset,
                                 Resource path)
                          throws IOException

Read .ref/.pred files produced by C99.

Throws:

IOException