| Package | Description |
|---|---|
| net.sf.okapi.steps.tokenization | |
| net.sf.okapi.steps.tokenization.common |
| Modifier and Type | Class and Description |
|---|---|
class |
Parameters
Tokenization step parameters
|
| Modifier and Type | Class and Description |
|---|---|
class |
LanguageAndTokenParameters |
class |
LexerRule |
class |
RegexRule |
Copyright © 2019. All rights reserved.