public class Tokeniser extends Object
| Modifier and Type | Field and Description |
|---|---|
protected int |
index |
protected int |
length |
protected String |
sourceText |
protected ArrayList<Token> |
tokens |
| Modifier | Constructor and Description |
|---|---|
protected |
Tokeniser(String sourceText) |
| Modifier and Type | Method and Description |
|---|---|
protected boolean |
eat(java.util.function.Function<String,Token> ctor,
Pattern pattern) |
protected Token[] |
tokenise() |
static Token[] |
tokenise(String sourceText) |
static String |
trimRHSWS(String s) |
Copyright © 2020. All rights reserved.