|
||||||||||
| PREV NEXT | FRAMES NO FRAMES | |||||||||
| Packages that use Detokenizer | |
|---|---|
| opennlp.tools.formats | Experimental package related to converting various corpora to OpenNLP Format. |
| opennlp.tools.formats.convert | |
| opennlp.tools.sentdetect | Package related to identifying sentece boundries. |
| opennlp.tools.tokenize | Contains classes related to finding token or words in a string. |
| Uses of Detokenizer in opennlp.tools.formats |
|---|
| Methods in opennlp.tools.formats that return Detokenizer | |
|---|---|
protected Detokenizer |
DetokenizerSampleStreamFactory.createDetokenizer(DetokenizerParameter p)
|
| Uses of Detokenizer in opennlp.tools.formats.convert |
|---|
| Constructors in opennlp.tools.formats.convert with parameters of type Detokenizer | |
|---|---|
NameToSentenceSampleStream(Detokenizer detokenizer,
ObjectStream<NameSample> samples,
int chunkSize)
|
|
NameToTokenSampleStream(Detokenizer detokenizer,
ObjectStream<NameSample> samples)
|
|
POSToSentenceSampleStream(Detokenizer detokenizer,
ObjectStream<POSSample> samples,
int chunkSize)
|
|
POSToTokenSampleStream(Detokenizer detokenizer,
ObjectStream<POSSample> samples)
|
|
| Uses of Detokenizer in opennlp.tools.sentdetect |
|---|
| Constructors in opennlp.tools.sentdetect with parameters of type Detokenizer | |
|---|---|
SentenceSample(Detokenizer detokenizer,
String[][] sentences)
|
|
| Uses of Detokenizer in opennlp.tools.tokenize |
|---|
| Classes in opennlp.tools.tokenize that implement Detokenizer | |
|---|---|
class |
DictionaryDetokenizer
A rule based detokenizer. |
| Constructors in opennlp.tools.tokenize with parameters of type Detokenizer | |
|---|---|
TokenSample(Detokenizer detokenizer,
String[] tokens)
|
|
|
||||||||||
| PREV NEXT | FRAMES NO FRAMES | |||||||||