net.morimekta.providence.reflect.parser.internal

Class ThriftTokenizer

java.lang.Object

java.io.Reader

net.morimekta.util.io.LineBufferedReader

net.morimekta.providence.serializer.pretty.Tokenizer

net.morimekta.providence.reflect.parser.internal.ThriftTokenizer

All Implemented Interfaces:

Closeable, AutoCloseable, Readable

public class ThriftTokenizer
extends Tokenizer

Specialization of the 'pretty' tokenizer to make it handle some special cases only applicable when parsing thrift files, but not allowed in pretty format or config files.

Nested Class Summary

Nested classes/interfaces inherited from class net.morimekta.providence.serializer.pretty.Tokenizer

Tokenizer.TokenValidator

Field Summary

Fields

Modifier and Type	Field and Description
static String	kBlockCommentEnd
static String	kBlockCommentStart
static String	kConst
static String	kEnum
static String	kException
static String	kExtends
static String	kInclude
static String	kLineCommentStart
static String	kNamespace
static String	kOneway
static String	kOptional
static String	kRequired
static String	kService
static String	kStruct
static String	kThrows
static String	kTypedef
static String	kUnion
static String	kVoid

Fields inherited from class net.morimekta.providence.serializer.pretty.Tokenizer

DEFAULT_BUFFER_SIZE

Fields inherited from class net.morimekta.util.io.LineBufferedReader

buffer, bufferLimit, bufferLineEnd, bufferOffset, lastChar, lineNo, linePos, preLoaded, reader

Fields inherited from class java.io.Reader

lock

Constructor Summary

Constructors

Constructor and Description
ThriftTokenizer(InputStream in)
ThriftTokenizer(Reader reader)

Method Summary

Modifier and Type	Method and Description
protected TokenizerException	failure(String format, Object... params)
protected Token	nextSymbol()
String	parseDocBlock()
Token	parseValue()

Methods inherited from class net.morimekta.providence.serializer.pretty.Tokenizer

eof, expect, expect, expectIdentifier, expectInteger, expectLiteral, expectSymbol, failure, failure, hasNext, next, peek, peek, readBinary

Methods inherited from class net.morimekta.util.io.LineBufferedReader

close, getLine, getLineNo, getLinePos, getRemainingLines, getRestOfLine, maybeConsolidateBuffer, read, read, readNextChar

Methods inherited from class java.io.Reader

mark, markSupported, read, read, ready, reset, skip

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

kNamespace

public static final String kNamespace

See Also:

Constant Field Values

kInclude

public static final String kInclude

See Also:

Constant Field Values

kTypedef

public static final String kTypedef

See Also:

Constant Field Values

kEnum

public static final String kEnum

See Also:

Constant Field Values

kStruct

public static final String kStruct

See Also:

Constant Field Values

kUnion

public static final String kUnion

See Also:

Constant Field Values

kException

public static final String kException

See Also:

Constant Field Values

kConst

public static final String kConst

See Also:

Constant Field Values

kService

public static final String kService

See Also:

Constant Field Values

kExtends

public static final String kExtends

See Also:

Constant Field Values

kVoid

public static final String kVoid

See Also:

Constant Field Values

kOneway

public static final String kOneway

See Also:

Constant Field Values

kThrows

public static final String kThrows

See Also:

Constant Field Values

kRequired

public static final String kRequired

See Also:

Constant Field Values

kOptional

public static final String kOptional

See Also:

Constant Field Values

kLineCommentStart

public static final String kLineCommentStart

See Also:

Constant Field Values

kBlockCommentStart

public static final String kBlockCommentStart

See Also:

Constant Field Values

kBlockCommentEnd

public static final String kBlockCommentEnd

See Also:

Constant Field Values

Constructor Detail

ThriftTokenizer

public ThriftTokenizer(InputStream in)

ThriftTokenizer

public ThriftTokenizer(Reader reader)

Method Detail

nextSymbol

@Nonnull
protected Token nextSymbol()
                             throws IOException

Overrides:

nextSymbol in class Tokenizer

Throws:

IOException

parseDocBlock

public String parseDocBlock()
                     throws IOException

Throws:

IOException

parseValue

public Token parseValue()
                 throws IOException

Throws:

IOException

failure

@Nonnull
protected TokenizerException failure(String format,
                                              Object... params)

Overrides:

failure in class Tokenizer