public class DictionaryDetokenizer extends Object implements Detokenizer
DetokenizationDictionary object.Detokenizer,
DetokenizationDictionaryDetokenizer.DetokenizationOperation| Constructor and Description |
|---|
DictionaryDetokenizer(DetokenizationDictionary dict) |
| Modifier and Type | Method and Description |
|---|---|
Detokenizer.DetokenizationOperation[] |
detokenize(String[] tokens)
Detokenize the input tokens.
|
String |
detokenize(String[] tokens,
String splitMarker)
Detokenize the input tokens into a String.
|
public DictionaryDetokenizer(DetokenizationDictionary dict)
public Detokenizer.DetokenizationOperation[] detokenize(String[] tokens)
Detokenizerdetokenize in interface Detokenizertokens - the tokens to detokenize.public String detokenize(String[] tokens, String splitMarker)
Detokenizerdetokenize in interface Detokenizertokens - the token which should be concatenatedsplitMarker - the split marker or nullCopyright © 2017 The Apache Software Foundation. All rights reserved.