Lexer

data class Lexer(source: Source, options: Any?, lastToken: Token, token: Token, line: Int, lineStart: Int)

Constructors

Lexer

fun Lexer(source: String)

advance

Advances the token stream to the next non-ignored token.

lookahead

Looks ahead and returns the next non-ignored token, but does not change the Lexer's state.

lastToken

The previously focused non-ignored token.

line

var line: Int = 1

The (1-indexed) line containing the current token.

lineStart

The character offset at which the current line begins.

options

val options: Any? = null

source

token

The currently focused non-ignored token.