Tokenizer (EvalEx 3.3.0 API)

java.lang.Object
- com.ezylang.evalex.parser.Tokenizer

```
public class Tokenizer
extends java.lang.Object
```
The tokenizer is responsible to parse a string and return a list of tokens. The order of tokens will follow the infix expression notation, skipping any blank characters.

Constructor Summary

Constructors
Constructor Description

Tokenizer(java.lang.String expressionString, ExpressionConfiguration configuration)

Method Summary

All Methods Instance Methods Concrete Methods
Modifier and Type	Method	Description
`java.util.List<Token>`	`parse()`	Parse the given expression and return a list of tokens, representing the expression.

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

- Constructor Detail
  - Tokenizer
```
public Tokenizer(java.lang.String expressionString,
                 ExpressionConfiguration configuration)
```
- Method Detail
  - parse
```
public java.util.List<Token> parse()
                            throws ParseException
```
    Parse the given expression and return a list of tokens, representing the expression.
    
    Returns:
    
    A list of expression tokens.
    
    Throws:
    
    ParseException - When the expression can't be parsed.