Package opennlp.tools.tokenize
Class WhitespaceTokenStream
- java.lang.Object
-
- opennlp.tools.util.FilterObjectStream<TokenSample,String>
-
- opennlp.tools.tokenize.WhitespaceTokenStream
-
- All Implemented Interfaces:
AutoCloseable,ObjectStream<String>
public class WhitespaceTokenStream extends FilterObjectStream<TokenSample,String>
This stream formatsObjectStreamofsamplesinto whitespace separated token strings.
-
-
Constructor Summary
Constructors Constructor Description WhitespaceTokenStream(ObjectStream<TokenSample> tokens)Initializes aWhitespaceTokenStream.
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description Stringread()Returns the nextObjectStreamobject.-
Methods inherited from class opennlp.tools.util.FilterObjectStream
close, reset
-
-
-
-
Constructor Detail
-
WhitespaceTokenStream
public WhitespaceTokenStream(ObjectStream<TokenSample> tokens)
Initializes aWhitespaceTokenStream.- Parameters:
tokens- Thestreamof tokens to be separated.
-
-
Method Detail
-
read
public String read() throws IOException
Description copied from interface:ObjectStreamReturns the nextObjectStreamobject. Calling this method repeatedly until it returnsnullwill return each object from the underlying source exactly once.- Returns:
- The next object or
nullto signal that the stream is exhausted. - Throws:
IOException- Thrown if there is an error during reading.
-
-