Uses of Class
opennlp.tools.tokenize.TokenizerFactory
-
Packages that use TokenizerFactory Package Description opennlp.tools.tokenize Contains classes related to finding token or words in a string. -
-
Uses of TokenizerFactory in opennlp.tools.tokenize
Methods in opennlp.tools.tokenize that return TokenizerFactory Modifier and Type Method Description static TokenizerFactoryTokenizerFactory. create(String subclassName, String languageCode, Dictionary abbreviationDictionary, boolean useAlphaNumericOptimization, Pattern alphaNumericPattern)Factory method the framework uses instantiate a newTokenizerFactory.TokenizerFactoryTokenizerModel. getFactory()Methods in opennlp.tools.tokenize with parameters of type TokenizerFactory Modifier and Type Method Description static TokenizerModelTokenizerME. train(ObjectStream<TokenSample> samples, TokenizerFactory factory, TrainingParameters mlParams)Trains a model for theTokenizerME.Constructors in opennlp.tools.tokenize with parameters of type TokenizerFactory Constructor Description TokenizerCrossValidator(TrainingParameters params, TokenizerFactory factory, TokenizerEvaluationMonitor... listeners)Creates aTokenizerCrossValidatorusing the givenTokenizerFactory.TokenizerModel(MaxentModel tokenizerModel, Map<String,String> manifestInfoEntries, TokenizerFactory tokenizerFactory)Initializes aTokenizerModelinstance via aMaxentModeland related resources.
-