com.aliasi.tokenizer

Class LowerCaseTokenizerFactory

java.lang.Object

com.aliasi.tokenizer.ModifiedTokenizerFactory

com.aliasi.tokenizer.ModifyTokenTokenizerFactory

com.aliasi.tokenizer.LowerCaseTokenizerFactory

All Implemented Interfaces:

TokenizerFactory, Serializable

public class LowerCaseTokenizerFactory
extends ModifyTokenTokenizerFactory
implements Serializable

A LowerCaseTokenizerFactory filters the tokenizers produced by a base tokenizer factory to produce lower case output. A locale must be specified in order to carry out the case conversion.

Thread Safety

A lowercasing tokenizer factory is thread safe if its base tokenizer factory is thread safe.

Serialization

A lowercasing tokenizer factory is serializable if its base tokenizer factory is serializable.

Since:

Lingpipe3.8

Version:

4.0.1

Author:

Bob Carpenter

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
LowerCaseTokenizerFactory(TokenizerFactory factory) Construct a lowercasing tokenizer factory from the specified base factory using the locale Locale.English
LowerCaseTokenizerFactory(TokenizerFactory factory, Locale locale) Construct a lowercasing tokenizer factory from the specified base factory using the specified locale.

Method Summary

Modifier and Type	Method and Description
Locale	locale() Return the locale for this factory.
String	modifyToken(String token) Return the lowercased version of the specified token using this factory's locale.
String	toString()

Methods inherited from class com.aliasi.tokenizer.ModifyTokenTokenizerFactory

modify, modifyWhitespace

Methods inherited from class com.aliasi.tokenizer.ModifiedTokenizerFactory

baseTokenizerFactory, tokenizer

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

LowerCaseTokenizerFactory

public LowerCaseTokenizerFactory(TokenizerFactory factory)

Construct a lowercasing tokenizer factory from the specified base factory using the locale Locale.English

Parameters:

factory - Base tokenizer factory.

LowerCaseTokenizerFactory

public LowerCaseTokenizerFactory(TokenizerFactory factory,
                                 Locale locale)

Construct a lowercasing tokenizer factory from the specified base factory using the specified locale.

Parameters:

factory - Base tokenizer factory.

locale - Locale to use for lowercasing.

Method Detail

locale

public Locale locale()

Return the locale for this factory.

Returns:

The locale for this factory.

modifyToken

public String modifyToken(String token)

Return the lowercased version of the specified token using this factory's locale.

Overrides:

modifyToken in class ModifyTokenTokenizerFactory

Parameters:

token - Token to modify.

Returns:

Lowercased token.

toString

public String toString()

Overrides:

toString in class ModifyTokenTokenizerFactory