Uses of Class
com.aliasi.tokenizer.Tokenization

Packages that use Tokenization

Package	Description
com.aliasi.suffixarray	Classes for spelling correction and edit distance.

Uses of Tokenization in com.aliasi.suffixarray

Methods in com.aliasi.suffixarray that return Tokenization

Modifier and Type	Method and Description
Tokenization	TokenSuffixArray.tokenization() Returns the tokenization underlying this suffix array.

Constructors in com.aliasi.suffixarray with parameters of type Tokenization

Constructor and Description
TokenSuffixArray(Tokenization tokenization) Construct at token suffix array with no limit on suffix length and the default document-boundary token.
TokenSuffixArray(Tokenization tokenization, int maxSuffixLength) Construct a suffix array from the specified tokenization, comparing suffixes using up the specified maximum suffix length using the default document-boundary token.
TokenSuffixArray(Tokenization tokenization, int maxSuffixLength, String documentBoundaryToken) Construct a suffix array from the specified tokenization, comparing suffixes using up the specified maximum suffix length using the default document-boundary token.