|
||||||||||
| PREV NEXT | FRAMES NO FRAMES | |||||||||
| Packages that use TokenContextGenerator | |
|---|---|
| opennlp.tools.tokenize | Contains classes related to finding token or words in a string. |
| opennlp.tools.tokenize.lang | |
| Uses of TokenContextGenerator in opennlp.tools.tokenize |
|---|
| Classes in opennlp.tools.tokenize that implement TokenContextGenerator | |
|---|---|
class |
DefaultTokenContextGenerator
Generate events for maxent decisions for tokenization. |
| Methods in opennlp.tools.tokenize that return TokenContextGenerator | |
|---|---|
TokenContextGenerator |
TokenizerFactory.getContextGenerator()
Gets the context generator |
| Constructors in opennlp.tools.tokenize with parameters of type TokenContextGenerator | |
|---|---|
TokSpanEventStream(ObjectStream<TokenSample> tokenSamples,
boolean skipAlphaNumerics,
Pattern alphaNumeric,
TokenContextGenerator cg)
Initializes the current instance. |
|
TokSpanEventStream(ObjectStream<TokenSample> tokenSamples,
boolean skipAlphaNumerics,
TokenContextGenerator cg)
Initializes the current instance. |
|
| Uses of TokenContextGenerator in opennlp.tools.tokenize.lang |
|---|
| Methods in opennlp.tools.tokenize.lang that return TokenContextGenerator | |
|---|---|
TokenContextGenerator |
Factory.createTokenContextGenerator(String languageCode,
Set<String> abbreviations)
|
|
||||||||||
| PREV NEXT | FRAMES NO FRAMES | |||||||||