Uses of Class
net.sf.okapi.steps.tokenization.engine.javacc.WordTokenizerTokenManager

Packages that use WordTokenizerTokenManager

Package	Description
net.sf.okapi.steps.tokenization.engine.javacc

Uses of WordTokenizerTokenManager in net.sf.okapi.steps.tokenization.engine.javacc

Fields in net.sf.okapi.steps.tokenization.engine.javacc declared as WordTokenizerTokenManager

Modifier and Type	Field and Description
WordTokenizerTokenManager	WordTokenizer.token_source Generated Token Manager.

Methods in net.sf.okapi.steps.tokenization.engine.javacc with parameters of type WordTokenizerTokenManager

Modifier and Type	Method and Description
void	WordTokenizer.ReInit(WordTokenizerTokenManager tm) Reinitialise.

Constructors in net.sf.okapi.steps.tokenization.engine.javacc with parameters of type WordTokenizerTokenManager

Constructor and Description
WordTokenizer(WordTokenizerTokenManager tm) Constructor with generated Token Manager.