| Package | Description |
|---|---|
| opennlp.tools.cmdline.tokenizer | |
| opennlp.tools.formats.brat | |
| opennlp.tools.tokenize |
Contains classes related to finding token or words in a string.
|
| Modifier and Type | Method and Description |
|---|---|
protected TokenizerModel |
TokenizerModelLoader.loadModel(InputStream modelIn) |
| Constructor and Description |
|---|
BratNameSampleStream(SentenceModel sentModel,
TokenizerModel tokenModel,
ObjectStream<BratDocument> samples) |
| Modifier and Type | Method and Description |
|---|---|
static TokenizerModel |
TokenizerME.train(ObjectStream<TokenSample> samples,
TokenizerFactory factory,
TrainingParameters mlParams)
Trains a model for the
TokenizerME. |
| Constructor and Description |
|---|
TokenizerME(TokenizerModel model) |
TokenizerME(TokenizerModel model,
Factory factory)
Deprecated.
use
TokenizerFactory to extend the Tokenizer
functionality |
Copyright © 2017 The Apache Software Foundation. All rights reserved.