|
|||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | ||||||||
java.lang.Objectopennlp.tools.tokenize.DictionaryDetokenizer
public class DictionaryDetokenizer
A rule based detokenizer. Simple rules which indicate in which direction a token should be
moved are looked up in a DetokenizationDictionary object.
Detokenizer,
DetokenizationDictionary| Nested Class Summary |
|---|
| Nested classes/interfaces inherited from interface opennlp.tools.tokenize.Detokenizer |
|---|
Detokenizer.DetokenizationOperation |
| Constructor Summary | |
|---|---|
DictionaryDetokenizer(DetokenizationDictionary dict)
|
|
| Method Summary | |
|---|---|
Detokenizer.DetokenizationOperation[] |
detokenize(java.lang.String[] tokens)
Detokenize the input tokens. |
| Methods inherited from class java.lang.Object |
|---|
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
| Constructor Detail |
|---|
public DictionaryDetokenizer(DetokenizationDictionary dict)
| Method Detail |
|---|
public Detokenizer.DetokenizationOperation[] detokenize(java.lang.String[] tokens)
Detokenizer
detokenize in interface Detokenizertokens - the tokens to detokenize.
|
|||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | ||||||||