public class CharacterNgramFeatureGenerator extends FeatureGeneratorAdapter
CharacterNgramFeatureGenerator uses character ngrams to
generate features about each token.
The minimum and maximum length can be specified.| Constructor and Description |
|---|
CharacterNgramFeatureGenerator()
Initializes the current instance with min 2 length and max 5 length of ngrams.
|
CharacterNgramFeatureGenerator(int minLength,
int maxLength) |
| Modifier and Type | Method and Description |
|---|---|
void |
createFeatures(List<String> features,
String[] tokens,
int index,
String[] preds)
Adds the appropriate features for the token at the specified index with the
specified array of previous outcomes to the specified list of features.
|
clearAdaptiveData, updateAdaptiveDatapublic CharacterNgramFeatureGenerator(int minLength,
int maxLength)
public CharacterNgramFeatureGenerator()
public void createFeatures(List<String> features, String[] tokens, int index, String[] preds)
AdaptiveFeatureGeneratorfeatures - The list of features to be added to.tokens - The tokens of the sentence or other text unit being processed.index - The index of the token which is currently being processed.preds - The outcomes for the tokens prior to the specified index.Copyright © 2015 The Apache Software Foundation. All rights reserved.