net.sf.okapi.steps.tokenization (Okapi Step for Tokenization 1.39.0 API)

Class Summary
Class	Description
Parameters	Tokenization step parameters
TokenizationStep
Tokenizer

Package net.sf.okapi.steps.tokenization