public class Tokenizer
extends java.lang.Object
Modifier and Type | Class and Description |
---|---|
static interface |
Tokenizer.ITokenizerGobbler |
static interface |
Tokenizer.ITokenizingContext |
static class |
Tokenizer.ResultConsume
Consumes a length of input.
|
static class |
Tokenizer.ResultDiscard
Discards a given length of input.
|
static class |
Tokenizer.ResultInvalid |
static class |
Tokenizer.ResultSpecific |
static interface |
Tokenizer.TokenResult |
Modifier and Type | Field and Description |
---|---|
static char |
END_OF_LINE |
Constructor and Description |
---|
Tokenizer(java.util.List<Tokenizer.ITokenizerGobbler> tokenizers) |
Tokenizer(Tokenizer.ITokenizerGobbler... tokenizers) |
Modifier and Type | Method and Description |
---|---|
java.lang.String[] |
tokenize(java.lang.String src) |
public static final char END_OF_LINE
public Tokenizer(java.util.List<Tokenizer.ITokenizerGobbler> tokenizers)
public Tokenizer(Tokenizer.ITokenizerGobbler... tokenizers)
public java.lang.String[] tokenize(java.lang.String src) throws InvalidExpressionException
InvalidExpressionException