Package opennlp.tools.parser
Class AbstractBottomUpParser
java.lang.Object
opennlp.tools.parser.AbstractBottomUpParser
- All Implemented Interfaces:
Parser
Abstract class which contains code to tag and chunk parses for bottom up parsing and
leaves implementation of advancing parses and completing parses to extend class.
Note:
The nodes within the returned parses are shared with other parses
and therefore their parent node references will not be consistent with their child
node reference. setParents can be used to make the parents consistent
with a particular parse, but subsequent calls to setParents can invalidate
the results of earlier calls.
-
Field Summary
FieldsModifier and TypeFieldDescriptionstatic final StringOutcome used when a constituent is complete.static final StringPrefix for outcomes continuing a constituent.static final doubleThe default amount of probability mass required of advanced outcomes.static final intThe default beam size used if no beam size is given.static final StringThe label for the top if an incomplete node.static final StringOutcome used when a constituent is incomplete.static final StringOutcome for token which is not contained in a basal constituent.static final StringPrefix for outcomes starting a constituent.static final StringThe label for a token node.static final StringThe label for the top node. -
Constructor Summary
ConstructorsConstructorDescriptionAbstractBottomUpParser(POSTagger tagger, Chunker chunker, HeadRules headRules, int beamSize, double advancePercentage) -
Method Summary
Modifier and TypeMethodDescriptionstatic DictionarybuildDictionary(ObjectStream<Parse> data, HeadRules rules, int cutoff) Creates a n-gramDictionaryfrom the specified data stream usingHeadRulesand specified cut-off.static DictionarybuildDictionary(ObjectStream<Parse> data, HeadRules rules, TrainingParameters params) Creates a n-gramDictionaryfrom the specified data stream using the specified head rule and specified cut-off.static Parse[]collapsePunctuation(Parse[] chunks, Set<String> punctSet) Removes the punctuation from the specified set ofchunks, adds it to the parses adjacent to the punctuation is specified, and returns a new array of parses with the punctuation removed.Parse[]Returns the specified number of parses or fewer for the specified tokens.voidsetErrorReporting(boolean errorReporting) Specifies whether the parser should report when it was unable to find a parse for a particular sentence.static voidsetParents(Parse p) Assigns parent references for the specified parse so that they are consistent with the children references.
-
Field Details
-
defaultBeamSize
public static final int defaultBeamSizeThe default beam size used if no beam size is given.- See Also:
-
defaultAdvancePercentage
public static final double defaultAdvancePercentageThe default amount of probability mass required of advanced outcomes.- See Also:
-
TOP_NODE
The label for the top node.- See Also:
-
INC_NODE
The label for the top if an incomplete node.- See Also:
-
TOK_NODE
The label for a token node.- See Also:
-
START
Prefix for outcomes starting a constituent.- See Also:
-
CONT
Prefix for outcomes continuing a constituent.- See Also:
-
OTHER
Outcome for token which is not contained in a basal constituent.- See Also:
-
COMPLETE
Outcome used when a constituent is complete.- See Also:
-
INCOMPLETE
Outcome used when a constituent is incomplete.- See Also:
-
-
Constructor Details
-
AbstractBottomUpParser
-
-
Method Details
-
setErrorReporting
public void setErrorReporting(boolean errorReporting) Specifies whether the parser should report when it was unable to find a parse for a particular sentence.- Parameters:
errorReporting-trueif un-parsed sentences should be reported,falseotherwise.
-
setParents
Assigns parent references for the specified parse so that they are consistent with the children references.- Parameters:
p- TheParsewhose parent references need to be assigned.
-
collapsePunctuation
Removes the punctuation from the specified set ofchunks, adds it to the parses adjacent to the punctuation is specified, and returns a new array of parses with the punctuation removed. -
parse
Description copied from interface:ParserReturns the specified number of parses or fewer for the specified tokens.Note: The nodes within the returned parses are shared with other parses and therefore their parent node references will not be consistent with their child node reference.
Parse.setParent(Parse)can be used to make the parents consistent with a particular parse, but subsequent calls tosetParentscan invalidate the results of earlier calls. -
parse
Description copied from interface:Parser -
buildDictionary
public static Dictionary buildDictionary(ObjectStream<Parse> data, HeadRules rules, TrainingParameters params) throws IOException Creates a n-gramDictionaryfrom the specified data stream using the specified head rule and specified cut-off.- Parameters:
data- The data stream ofparses.rules- TheHeadRulesfor the parses.params- TheTrainingParameterswhich can contain acutoff, the minimum number of entries required for the n-gram to be saved as part of theDictionary.- Returns:
- A
Dictionaryinstance. - Throws:
IOException
-
buildDictionary
public static Dictionary buildDictionary(ObjectStream<Parse> data, HeadRules rules, int cutoff) throws IOException Creates a n-gramDictionaryfrom the specified data stream usingHeadRulesand specified cut-off.- Parameters:
data- The data stream ofparses.rules- TheHeadRulesfor theparses.cutoff- The minimum number of entries required for the n-gram to be saved as part of the dictionary.- Returns:
- A
Dictionaryinstance. - Throws:
IOException
-