Package opennlp.tools.util.featuregen
Interface AdaptiveFeatureGenerator
-
- All Known Implementing Classes:
AdditionalContextFeatureGenerator,AggregatedFeatureGenerator,BigramNameFeatureGenerator,BrownBigramFeatureGenerator,BrownTokenClassFeatureGenerator,BrownTokenFeatureGenerator,CachedFeatureGenerator,CharacterNgramFeatureGenerator,CustomFeatureGenerator,DictionaryFeatureGenerator,DocumentBeginFeatureGenerator,InSpanGenerator,OutcomePriorFeatureGenerator,PosTaggerFeatureGenerator,POSTaggerNameFeatureGenerator,PrefixFeatureGenerator,PreviousMapFeatureGenerator,PreviousTwoMapFeatureGenerator,SentenceFeatureGenerator,SuffixFeatureGenerator,TokenClassFeatureGenerator,TokenFeatureGenerator,TokenPatternFeatureGenerator,TrigramNameFeatureGenerator,WindowFeatureGenerator,WordClusterFeatureGenerator
public interface AdaptiveFeatureGeneratorAn interface for generating features for name entity identification and for updating document level contexts.Note:
Feature generation is not thread safe and a instance of a feature generator must only be called from one thread. The resources used by a feature generator are typically shared between many instances of features generators which are called from many threads and have to be thread safe.
-
-
Method Summary
All Methods Instance Methods Abstract Methods Default Methods Modifier and Type Method Description default voidclearAdaptiveData()Informs a feature generator that the context of the adaptive data (typically a document) is no longer valid.voidcreateFeatures(List<String> features, String[] tokens, int index, String[] previousOutcomes)Adds the appropriate features for the token at the specifiedindexwith the specified array ofpreviousOutcomesto the specified list of features.default voidupdateAdaptiveData(String[] tokens, String[] outcomes)Informs a feature generator that the specified tokens have been classified with the corresponding set of specifiedoutcomes.
-
-
-
Method Detail
-
createFeatures
void createFeatures(List<String> features, String[] tokens, int index, String[] previousOutcomes)
Adds the appropriate features for the token at the specifiedindexwith the specified array ofpreviousOutcomesto the specified list of features.- Parameters:
features- The list of features to be added to.tokens- The tokens of the sentence or other text unit being processed.index- The index of the token which is currently being processed.previousOutcomes- The outcomes for the tokens prior to the specified index.
-
updateAdaptiveData
default void updateAdaptiveData(String[] tokens, String[] outcomes)
Informs a feature generator that the specified tokens have been classified with the corresponding set of specifiedoutcomes.- Parameters:
tokens- The tokens of the sentence or other text unit which has been processed.outcomes- The outcomes associated with the specified tokens.
-
clearAdaptiveData
default void clearAdaptiveData()
Informs a feature generator that the context of the adaptive data (typically a document) is no longer valid.
-
-