data class Token
Represents a range of characters represented by a lexical token within a Source.
<init> |
Represents a range of characters represented by a lexical token within a Source. Token(kind: TokenKindEnum, start: Int = 0, end: Int = 0, line: Int = 0, column: Int = 0, value: String? = null, prev: Token? = null, next: Token? = null) |
column |
The 1-indexed column number at which this Token begins. val column: Int |
end |
The character offset at which this Node ends. val end: Int |
kind |
The kind of Token. val kind: TokenKindEnum |
line |
The 1-indexed line number on which this Token appears. val line: Int |
next |
var next: Token? |
prev |
Tokens exist as nodes in a double-linked-list amongst all tokens including ignored tokens. is always the first node and the last. var prev: Token? |
start |
The character offset at which this Node begins. val start: Int |
value |
For non-punctuation tokens, represents the interpreted value of the token. val value: String? |
toString |
fun toString(): String |