Token

data class Token(kind: TokenKindEnum, start: Int, end: Int, line: Int, column: Int, value: String?, prev: Token?, next: Token?)

Represents a range of characters represented by a lexical token within a Source.

Constructors

Token

fun Token(kind: TokenKindEnum, start: Int = 0, end: Int = 0, line: Int = 0, column: Int = 0, value: String? = null, prev: Token? = null, next: Token? = null)

toString

open override fun toString(): String

column

val column: Int = 0

The 1-indexed column number at which this Token begins.

end

val end: Int = 0

The character offset at which this Node ends.

kind

The kind of Token.

line

val line: Int = 0

The 1-indexed line number on which this Token appears.

var next: Token? = null

var prev: Token? = null

Tokens exist as nodes in a double-linked-list amongst all tokens including ignored tokens.

start

val start: Int = 0

The character offset at which this Node begins.

value

val value: String? = null

For non-punctuation tokens, represents the interpreted value of the token.