Defines an interface for tokenizer state that processes delimiters.
Implements: ITokenizerState
Description
The ISymbolState interface is used for tokenizer states that process delimiters.
Instance methods
add
Add a multi-character symbol.
void add(String value, TokenType tokenType) throws Exception
- value: string - symbol to add, such as "=:=".
- tokenType: TokenType - token type.