public class TokenizerStream extends Object implements ObjectStream<TokenSample>
TokenizerStream uses a tokenizer to tokenize the
input string and output TokenSamples.| Constructor and Description |
|---|
TokenizerStream(Tokenizer tokenizer,
ObjectStream<String> input) |
| Modifier and Type | Method and Description |
|---|---|
void |
close()
Closes the
ObjectStream and releases all allocated
resources. |
TokenSample |
read()
Returns the next object.
|
void |
reset()
Repositions the stream at the beginning and the previously seen object sequence
will be repeated exactly.
|
public TokenizerStream(Tokenizer tokenizer, ObjectStream<String> input)
public TokenSample read() throws IOException
ObjectStreamread in interface ObjectStream<TokenSample>IOException - if there is an error during readingpublic void close()
throws IOException
ObjectStreamObjectStream and releases all allocated
resources. After close was called its not allowed to call
read or reset.close in interface AutoCloseableclose in interface ObjectStream<TokenSample>IOException - if there is an error during closing the streampublic void reset()
throws IOException,
UnsupportedOperationException
ObjectStreamreset in interface ObjectStream<TokenSample>IOException - if there is an error during reseting the streamUnsupportedOperationExceptionCopyright © 2017 The Apache Software Foundation. All rights reserved.