| Package | Description |
|---|---|
| net.sf.okapi.steps.tokenization | |
| net.sf.okapi.steps.tokenization.common | |
| net.sf.okapi.steps.tokenization.engine |
| Modifier and Type | Method and Description |
|---|---|
List<ILexer> |
TokenizationStep.getLexers() |
| Modifier and Type | Method and Description |
|---|---|
void |
TokenizationStep.setLexers(List<ILexer> lexers) |
| Modifier and Type | Class and Description |
|---|---|
class |
AbstractLexer |
| Modifier and Type | Class and Description |
|---|---|
class |
GarbageCollector |
class |
JavaCcLexer |
class |
LookUpLexer |
class |
RbbiLexer |
class |
Reconciler |
class |
Remover |
class |
Retainer |
class |
Sorter |
class |
TextScanner |
class |
TokenMatcher |
class |
TokenScanner |
Copyright © 2021. All rights reserved.