de.uni_leipzig.asv.utils.tokenizer

Class DoNothingWordTokenizerImpl

java.lang.Object

de.uni_leipzig.asv.utils.tokenizer.AbstractWordTokenizerImpl

de.uni_leipzig.asv.utils.tokenizer.DoNothingWordTokenizerImpl

public class DoNothingWordTokenizerImpl
extends AbstractWordTokenizerImpl

Using external tokenized text you should use the tokenizer which don't apply any tokenizer rule to a sentence.

Author:

mbuechler

Field Summary

Fields inherited from class de.uni_leipzig.asv.utils.tokenizer.AbstractWordTokenizerImpl

EXPLIZIT_CUT, objAbbrevList, strAbbrevListFile

Constructor Summary

Constructors

Constructor and Description
DoNothingWordTokenizerImpl() Creates a new instance of DoNothingWordTokenizerImpl

Method Summary

Methods

Modifier and Type	Method and Description
String	execute(String strLine)

Methods inherited from class de.uni_leipzig.asv.utils.tokenizer.AbstractWordTokenizerImpl

getWhiteSpaceBeforeDot, getWhitespacePositions

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DoNothingWordTokenizerImpl

public DoNothingWordTokenizerImpl()

Creates a new instance of DoNothingWordTokenizerImpl

Method Detail

execute

public String execute(String strLine)

Overrides:

execute in class AbstractWordTokenizerImpl