| Package | Description |
|---|---|
| opennlp.tools.tokenize |
Contains classes related to finding token or words in a string.
|
| Modifier and Type | Method and Description |
|---|---|
static TokenizerFactory |
TokenizerFactory.create(String subclassName,
String languageCode,
Dictionary abbreviationDictionary,
boolean useAlphaNumericOptimization,
Pattern alphaNumericPattern)
Factory method the framework uses create a new
TokenizerFactory. |
TokenizerFactory |
TokenizerModel.getFactory() |
| Modifier and Type | Method and Description |
|---|---|
static TokenizerModel |
TokenizerME.train(ObjectStream<TokenSample> samples,
TokenizerFactory factory,
TrainingParameters mlParams)
Trains a model for the
TokenizerME. |
| Constructor and Description |
|---|
TokenizerCrossValidator(TrainingParameters params,
TokenizerFactory factory,
TokenizerEvaluationMonitor... listeners) |
TokenizerModel(MaxentModel tokenizerModel,
Map<String,String> manifestInfoEntries,
TokenizerFactory tokenizerFactory)
Initializes the current instance.
|
Copyright © 2017 The Apache Software Foundation. All rights reserved.