| Package | Description |
|---|---|
| de.uni_leipzig.asv.utils.tokenizer |
| Modifier and Type | Class and Description |
|---|---|
class |
DoNothingWordTokenizerImpl
Using external tokenized text you should use the tokenizer which don't apply
any tokenizer rule to a sentence.
|
class |
ImprovedWordTokenizer |
Copyright © 2013. All rights reserved.