Package jasima.core.util.converter

Class ArgListTokenizer

java.lang.Object

jasima.core.util.converter.ArgListTokenizer

public class ArgListTokenizer
extends Object

Splits an input string in tokens, so lists and parameter lists can be recognized. This class recognizes (quoted) Strings with back-slash as an escape character, white space, and as special one-character tokens: "(", ")", ";", "=".

Author:

Torsten Hildebrandt

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	ArgListTokenizer.ParseException	A ParseException is thrown if there were problems splitting the input string into tokens.
static class	ArgListTokenizer.TokenType	The recognized tokens.

Constructor Summary

Constructors

Constructor	Description
ArgListTokenizer()
ArgListTokenizer(String input)

Method Summary

Modifier and Type	Method	Description
void	assureTokenTypes(ArgListTokenizer.TokenType actual, ArgListTokenizer.TokenType... expected)	Checks whether the actual token's type matches a certain set of expected types.
int	currTokenEnd()
int	currTokenStart()
String	currTokenText()	Returns the portion of the input text that is associated with the current token.
ArgListTokenizer.TokenType	currTokenType()
static String	escapeString(String raw)
ArgListTokenizer.TokenType	nextToken()	Returns the next token in the input String.
ArgListTokenizer.TokenType	nextTokenNoWhitespace()	Returns the next token that is not whitespace.
void	pushBackToken()	Resets the current reading position back to beginning of the current token, so nextToken() will see the same token again.
static String	quoteString(String raw)
protected void	reset()
void	setInput(String input)	Sets the input string to work on.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ArgListTokenizer

public ArgListTokenizer()

ArgListTokenizer

public ArgListTokenizer(String input)

Method Detail

reset

protected void reset()

nextTokenNoWhitespace

public ArgListTokenizer.TokenType nextTokenNoWhitespace()

Returns the next token that is not whitespace.

Returns:

The type of the next token that is not WHITE_SPACE.

nextToken

public ArgListTokenizer.TokenType nextToken()

Returns the next token in the input String. This is on of the values of ArgListTokenizer.TokenType, or null, if the end of the input was reached. This method can throw the unchecked ArgListTokenizer.ParseException, if there was a problem splitting the input string in tokens.

Returns:

The current token's type.

currTokenText

public String currTokenText()

Returns the portion of the input text that is associated with the current token. This method does not return surrounding quotes of a quoted STRING and unescapes any escaped characters.

Returns:

The current token's text.

currTokenType

public ArgListTokenizer.TokenType currTokenType()

currTokenStart

public int currTokenStart()

currTokenEnd

public int currTokenEnd()

pushBackToken

public void pushBackToken()

Resets the current reading position back to beginning of the current token, so nextToken() will see the same token again. This is useful, if a parser detects a token he can't handle but has to pass back to a parent parser for proper processing.

setInput

public void setInput(String input)

Sets the input string to work on.

Parameters:

input - The input string.

assureTokenTypes

public void assureTokenTypes(ArgListTokenizer.TokenType actual,
                             ArgListTokenizer.TokenType... expected)
                      throws ArgListTokenizer.ParseException

Checks whether the actual token's type matches a certain set of expected types. If the types do not match, then a ArgListTokenizer.ParseException is raised.

Parameters:

actual - The current token's type.

expected - All token types that are currently valid.

Throws:

ArgListTokenizer.ParseException - If actual if not contained in expected.

escapeString

public static String escapeString(String raw)

quoteString

public static String quoteString(String raw)