Package opennlp.tools.util.featuregen
Class CharacterNgramFeatureGenerator
java.lang.Object
opennlp.tools.util.featuregen.CharacterNgramFeatureGenerator
- All Implemented Interfaces:
AdaptiveFeatureGenerator
The
CharacterNgramFeatureGenerator uses character ngrams to
generate features about each token.-
Constructor Summary
ConstructorsConstructorDescriptionInitializes aCharacterNgramFeatureGeneratorwith min 2 length and max 5 length of ngrams.CharacterNgramFeatureGenerator(int minLength, int maxLength) Initializes aCharacterNgramFeatureGenerator. -
Method Summary
Modifier and TypeMethodDescriptionvoidcreateFeatures(List<String> features, String[] tokens, int index, String[] preds) Adds the appropriate features for the token at the specifiedindexwith the specified array ofpreviousOutcomesto the specified list of features.Methods inherited from class java.lang.Object
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, waitMethods inherited from interface opennlp.tools.util.featuregen.AdaptiveFeatureGenerator
clearAdaptiveData, updateAdaptiveData
-
Constructor Details
-
CharacterNgramFeatureGenerator
public CharacterNgramFeatureGenerator(int minLength, int maxLength) Initializes aCharacterNgramFeatureGenerator.- Parameters:
minLength- The minimum length to use. Must not be negative.maxLength- The maximum length to use. Must not be negative.
-
CharacterNgramFeatureGenerator
public CharacterNgramFeatureGenerator()Initializes aCharacterNgramFeatureGeneratorwith min 2 length and max 5 length of ngrams.
-
-
Method Details
-
createFeatures
Description copied from interface:AdaptiveFeatureGeneratorAdds the appropriate features for the token at the specifiedindexwith the specified array ofpreviousOutcomesto the specified list of features.- Specified by:
createFeaturesin interfaceAdaptiveFeatureGenerator- Parameters:
features- The list of features to be added to.tokens- The tokens of the sentence or other text unit being processed.index- The index of the token which is currently being processed.preds- The outcomes for the tokens prior to the specified index.
-