Package opennlp.tools.formats.ad
Class ADChunkSampleStream
- java.lang.Object
-
- opennlp.tools.formats.ad.ADChunkSampleStream
-
- All Implemented Interfaces:
AutoCloseable,ObjectStream<ChunkSample>
@Internal public class ADChunkSampleStream extends Object implements ObjectStream<ChunkSample>
Parser for Floresta Sita(c)tica Arvores Deitadas corpus, output to for the Portuguese Chunker training.The heuristic to extract chunks where based o paper 'A Machine Learning Approach to Portuguese Clause Identification', (Eraldo Fernandes, Cicero Santos and Ruy Milidiú).
Data can be found on this web site.
Information about the format:
Susana Afonso. "Árvores deitadas: Descrição do formato e das opções de análise na Floresta Sintáctica".
12 de Fevereiro de 2006.Detailed info about the NER tagset.
Note: Do not use this class, internal use only!
-
-
Constructor Summary
Constructors Constructor Description ADChunkSampleStream(InputStreamFactory in, String charsetName)Instantiates aADChunkSampleStreamstream from anInputStreamFactory.ADChunkSampleStream(ObjectStream<String> lineStream)Instantiates aADChunkSampleStreamstream fromObjectStream, that could be aPlainTextByLineStreamobject.
-
Method Summary
All Methods Static Methods Instance Methods Concrete Methods Modifier and Type Method Description voidclose()Closes theObjectStreamand releases all allocated resources.static StringconvertFuncTag(String t, boolean useCGTags)ChunkSampleread()Returns the nextObjectStreamobject.voidreset()Repositions the stream at the beginning and the previously seen object sequence will be repeated exactly.voidsetEnd(int aEnd)voidsetStart(int aStart)
-
-
-
Field Detail
-
OTHER
public static final String OTHER
- See Also:
- Constant Field Values
-
-
Constructor Detail
-
ADChunkSampleStream
public ADChunkSampleStream(ObjectStream<String> lineStream)
Instantiates aADChunkSampleStreamstream fromObjectStream, that could be aPlainTextByLineStreamobject.- Parameters:
lineStream- AnObjectStreamas input.
-
ADChunkSampleStream
public ADChunkSampleStream(InputStreamFactory in, String charsetName) throws IOException
Instantiates aADChunkSampleStreamstream from anInputStreamFactory.- Parameters:
in- TheInputStreamFactoryfor the corpus.charsetName- Thecharsetto use for reading of the corpus.- Throws:
IOException
-
-
Method Detail
-
read
public ChunkSample read() throws IOException
Description copied from interface:ObjectStreamReturns the nextObjectStreamobject. Calling this method repeatedly until it returnsnullwill return each object from the underlying source exactly once.- Specified by:
readin interfaceObjectStream<ChunkSample>- Returns:
- The next object or
nullto signal that the stream is exhausted. - Throws:
IOException- Thrown if there is an error during reading.
-
setStart
public void setStart(int aStart)
-
setEnd
public void setEnd(int aEnd)
-
reset
public void reset() throws IOException, UnsupportedOperationExceptionDescription copied from interface:ObjectStreamRepositions the stream at the beginning and the previously seen object sequence will be repeated exactly. This method can be used to re-read the stream if multiple passes over the objects are required.The implementation of this method is optional.
- Specified by:
resetin interfaceObjectStream<ChunkSample>- Throws:
IOException- Thrown if there is an error during resetting the stream.UnsupportedOperationException- Thrown if thereset()is not supported. By default, this is the case.
-
close
public void close() throws IOExceptionDescription copied from interface:ObjectStreamCloses theObjectStreamand releases all allocated resources. After close was called, it's not allowed to callObjectStream.read()orObjectStream.reset().- Specified by:
closein interfaceAutoCloseable- Specified by:
closein interfaceObjectStream<ChunkSample>- Throws:
IOException- Thrown if there is an error during closing the stream.
-
-