de.uni_leipzig.asv.utils.tokenizer

Class AbstractWordTokenizerImpl

java.lang.Object

de.uni_leipzig.asv.utils.tokenizer.AbstractWordTokenizerImpl

Direct Known Subclasses:

DoNothingWordTokenizerImpl, ImprovedWordTokenizer

public abstract class AbstractWordTokenizerImpl
extends Object

Author:

development

Field Summary

Fields

Modifier and Type	Field and Description
String[]	EXPLIZIT_CUT
protected Set<String>	objAbbrevList
protected String	strAbbrevListFile

Constructor Summary

Constructors

Constructor and Description
AbstractWordTokenizerImpl() Creates a new instance of AbstractWordTokenizerImpl

Method Summary

Methods

Modifier and Type	Method and Description
String	execute(String strLine)
protected int	getWhiteSpaceBeforeDot(int intPosDot, String strFragment)
protected ArrayList<int[]>	getWhitespacePositions(String strCurLine)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

EXPLIZIT_CUT

public final String[] EXPLIZIT_CUT

strAbbrevListFile

protected String strAbbrevListFile

objAbbrevList

protected Set<String> objAbbrevList

Constructor Detail

AbstractWordTokenizerImpl

public AbstractWordTokenizerImpl()

Creates a new instance of AbstractWordTokenizerImpl

Method Detail

getWhiteSpaceBeforeDot

protected int getWhiteSpaceBeforeDot(int intPosDot,
                         String strFragment)

execute

public String execute(String strLine)

getWhitespacePositions

protected ArrayList<int[]> getWhitespacePositions(String strCurLine)