public class DefaultTokenContextGenerator extends Object implements TokenContextGenerator
| Constructor and Description |
|---|
DefaultTokenContextGenerator()
Creates a default context generator for tokenizer.
|
DefaultTokenContextGenerator(Set<String> inducedAbbreviations)
Creates a default context generator for tokenizer.
|
| Modifier and Type | Method and Description |
|---|---|
String[] |
getContext(String sentence,
int index)
Returns an array of features for the specified sentence string at the specified index.
|
public DefaultTokenContextGenerator()
public String[] getContext(String sentence, int index)
TokenContextGeneratorgetContext in interface TokenContextGeneratorsentence - The string for a sentence.index - The index to consider splitting as a token.Copyright © 2015 The Apache Software Foundation. All rights reserved.