io.github.applecommander.bastokenizer.api

Class TokenReader

java.lang.Object

io.github.applecommander.bastokenizer.api.TokenReader

public class TokenReader
extends java.lang.Object

The TokenReader, given a text file, generates a series of Tokens (in the compiler sense, not AppleSoft) for the AppleSoft program.

Constructor Summary

Constructors

Constructor and Description
TokenReader(java.io.Reader reader)

Method Summary

Modifier and Type	Method and Description
boolean	hasMore()
java.util.Optional<Token>	next(int depth)
static java.util.Queue<Token>	tokenize(java.io.File file) A handy method to generate a list of Tokens from a file.
static java.util.Queue<Token>	tokenize(java.io.InputStream inputStream) A handy method to generate a list of Tokens from an InputStream.
static java.util.Queue<Token>	tokenize(java.lang.String filename) A handy method to generate a list of Tokens from a file name.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TokenReader

public TokenReader(java.io.Reader reader)

Method Detail

tokenize

public static java.util.Queue<Token> tokenize(java.lang.String filename)
                                       throws java.io.FileNotFoundException,
                                              java.io.IOException

A handy method to generate a list of Tokens from a file name.

Throws:

java.io.FileNotFoundException

java.io.IOException

tokenize

public static java.util.Queue<Token> tokenize(java.io.File file)
                                       throws java.io.FileNotFoundException,
                                              java.io.IOException

A handy method to generate a list of Tokens from a file.

Throws:

java.io.FileNotFoundException

java.io.IOException

tokenize

public static java.util.Queue<Token> tokenize(java.io.InputStream inputStream)
                                       throws java.io.IOException

A handy method to generate a list of Tokens from an InputStream.

Throws:

java.io.IOException

hasMore

public boolean hasMore()

next

public java.util.Optional<Token> next(int depth)
                               throws java.io.IOException

Throws:

java.io.IOException