com.agimatec.sql.script
Class WordTokenizer

java.lang.Object
  com.agimatec.sql.script.WordTokenizer

public final class WordTokenizer
extends java.lang.Object

Title: Agimatec GmbH

Description: This class can be used like the java.util.StringTokenizer. The main difference is, that the separator tokens are Strings not characters.

Copyright: Copyright (c) 2007

Company: Agimatec GmbH

Author:

Roman Stumm

Constructor Summary

WordTokenizer(java.io.Reader input, java.lang.String[] separatorTokens)
convenience - returnSeparators = false, caseSensitive = true

WordTokenizer(java.io.Reader input, java.lang.String[] separatorTokens, boolean returnSeparators)
convenience - caseSensitive = true

WordTokenizer(java.io.Reader input, java.lang.String[] separatorTokens, boolean returnSeparators, boolean aCaseSensitive)
full constructor.

WordTokenizer(WordTokenizer parent, java.lang.String[] separatorTokens, boolean returnSeparators, boolean aCaseSensitive)
create a child!

Method Summary

protected void	addChar(int next)
void	continueFrom(WordTokenizer child)
java.io.Reader	getReader()
boolean	isSeparator(java.lang.String token) return true if the token is one of the receiver's separator tokens
protected int	nextChar()
java.lang.String	nextToken()
protected int	readNext()
void	setCaseSensitive(boolean aCaseSensitive)
void	setReturnTokens(boolean aReturnTokens)
void	setSeparators(java.lang.String[] aSeparators)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WordTokenizer

public WordTokenizer(java.io.Reader input,
                     java.lang.String[] separatorTokens,
                     boolean returnSeparators,
                     boolean aCaseSensitive)

full constructor.

Parameters:

input - - a reader that reads the string to be parsed

separatorTokens - - array of separator strings

returnSeparators - - true when nextToken() should return separators, false otherwise

aCaseSensitive - - true when separators are caseSensitive (faster), false otherwise (slower)

WordTokenizer

public WordTokenizer(WordTokenizer parent,
                     java.lang.String[] separatorTokens,
                     boolean returnSeparators,
                     boolean aCaseSensitive)

create a child!

Parameters:

parent -

separatorTokens -

returnSeparators -

aCaseSensitive -

WordTokenizer

public WordTokenizer(java.io.Reader input,
                     java.lang.String[] separatorTokens,
                     boolean returnSeparators)

convenience - caseSensitive = true

Parameters:

input -

separatorTokens -

returnSeparators -

WordTokenizer

public WordTokenizer(java.io.Reader input,
                     java.lang.String[] separatorTokens)

convenience - returnSeparators = false, caseSensitive = true

Parameters:

input -

separatorTokens -

Method Detail

continueFrom

public void continueFrom(WordTokenizer child)

setSeparators

public void setSeparators(java.lang.String[] aSeparators)

setCaseSensitive

public void setCaseSensitive(boolean aCaseSensitive)

setReturnTokens

public void setReturnTokens(boolean aReturnTokens)

nextToken

public java.lang.String nextToken()
                           throws java.io.IOException

Returns:

null when there are no more tokens, the next token otherwise

Throws:

java.io.IOException

nextChar

protected int nextChar()
                throws java.io.IOException

Throws:

java.io.IOException

readNext

protected int readNext()
                throws java.io.IOException

Throws:

java.io.IOException

getReader

public java.io.Reader getReader()

addChar

protected void addChar(int next)

isSeparator

public boolean isSeparator(java.lang.String token)

return true if the token is one of the receiver's separator tokens

Parameters:

token - - Not null!

Returns: