|
||||||||||
| PREV NEXT | FRAMES NO FRAMES | |||||||||
| Packages that use TokenizerModel | |
|---|---|
| opennlp.tools.cmdline.tokenizer | |
| opennlp.tools.tokenize | Contains classes related to finding token or words in a string. |
| Uses of TokenizerModel in opennlp.tools.cmdline.tokenizer |
|---|
| Methods in opennlp.tools.cmdline.tokenizer that return TokenizerModel | |
|---|---|
protected TokenizerModel |
TokenizerModelLoader.loadModel(InputStream modelIn)
|
| Uses of TokenizerModel in opennlp.tools.tokenize |
|---|
| Methods in opennlp.tools.tokenize that return TokenizerModel | |
|---|---|
static TokenizerModel |
TokenizerME.train(ObjectStream<TokenSample> samples,
TokenizerFactory factory,
TrainingParameters mlParams)
Trains a model for the TokenizerME. |
static TokenizerModel |
TokenizerME.train(String languageCode,
ObjectStream<TokenSample> samples,
boolean useAlphaNumericOptimization)
Deprecated. Use #train(String, ObjectStream, TokenizerFactory, TrainingParameters)
and pass in a TokenizerFactory |
static TokenizerModel |
TokenizerME.train(String languageCode,
ObjectStream<TokenSample> samples,
boolean useAlphaNumericOptimization,
int cutoff,
int iterations)
Deprecated. Use #train(String, ObjectStream, TokenizerFactory, TrainingParameters)
and pass in a TokenizerFactory |
static TokenizerModel |
TokenizerME.train(String languageCode,
ObjectStream<TokenSample> samples,
boolean useAlphaNumericOptimization,
TrainingParameters mlParams)
Deprecated. Use #train(String, ObjectStream, TokenizerFactory, TrainingParameters)
and pass in a TokenizerFactory |
static TokenizerModel |
TokenizerME.train(String languageCode,
ObjectStream<TokenSample> samples,
Dictionary abbreviations,
boolean useAlphaNumericOptimization,
TrainingParameters mlParams)
Deprecated. Use #train(String, ObjectStream, TokenizerFactory, TrainingParameters)
and pass in a TokenizerFactory |
| Constructors in opennlp.tools.tokenize with parameters of type TokenizerModel | |
|---|---|
TokenizerME(TokenizerModel model)
|
|
TokenizerME(TokenizerModel model,
Factory factory)
Deprecated. use TokenizerFactory to extend the Tokenizer
functionality |
|
|
||||||||||
| PREV NEXT | FRAMES NO FRAMES | |||||||||