Uses of Class
opennlp.tools.tokenize.TokenizerModel
-
Packages that use TokenizerModel Package Description opennlp.tools.cmdline.tokenizer opennlp.tools.formats.brat Experimental package related to the corpus format used by the "brat rapid annotation tool" (brat).opennlp.tools.tokenize Contains classes related to finding token or words in a string. -
-
Uses of TokenizerModel in opennlp.tools.cmdline.tokenizer
Methods in opennlp.tools.cmdline.tokenizer that return TokenizerModel Modifier and Type Method Description protected TokenizerModelTokenizerModelLoader. loadModel(InputStream modelIn) -
Uses of TokenizerModel in opennlp.tools.formats.brat
Constructors in opennlp.tools.formats.brat with parameters of type TokenizerModel Constructor Description BratNameSampleStream(SentenceModel sentModel, TokenizerModel tokenModel, ObjectStream<BratDocument> samples)Creates a newBratNameSampleStream.BratNameSampleStream(SentenceModel sentModel, TokenizerModel tokenModel, ObjectStream<BratDocument> samples, Set<String> nameTypes)Creates a newBratNameSampleStream. -
Uses of TokenizerModel in opennlp.tools.tokenize
Methods in opennlp.tools.tokenize that return TokenizerModel Modifier and Type Method Description static TokenizerModelTokenizerME. train(ObjectStream<TokenSample> samples, TokenizerFactory factory, TrainingParameters mlParams)Trains a model for theTokenizerME.Constructors in opennlp.tools.tokenize with parameters of type TokenizerModel Constructor Description TokenizerME(TokenizerModel model)Instantiates aTokenizerMEwith an existingTokenizerModel.TokenizerME(TokenizerModel model, Factory factory)Deprecated.useTokenizerFactoryto extend the Tokenizer functionality
-