public class EOFLexer extends Lexer
Lexer, only fullstop tokens are replaced
by EOF tokens. This way an input stream can be parsed several times (from
fullstop to fullstop) without the need to write the input into an extra
buffer and split it manually.| Modifier and Type | Class and Description |
|---|---|
static class |
EOFLexer.AbortException |
Lexer.State| Constructor and Description |
|---|
EOFLexer(java.io.PushbackReader in) |
EOFLexer(java.io.Reader in) |
| Modifier and Type | Method and Description |
|---|---|
Token |
next() |
Token |
peek() |
filter, filterWrap, getNextList, getToken, getTokenList, setTokenList, unreadpublic EOFLexer(java.io.PushbackReader in)
public EOFLexer(java.io.Reader in)
public Token next() throws LexerException, java.io.IOException
next in class LexerLexerExceptionjava.io.IOExceptionpublic Token peek() throws LexerException, java.io.IOException
peek in class LexerLexerExceptionjava.io.IOException