Defines an interface for tokenizer state that processes delimiters.
Extends: ITokenizerState
Description
The ISymbolState interface is used for tokenizer states that process delimiters.
Instance methods
add
Add a multi-character symbol.
void add(String value, TokenType tokenType)
- value: String - symbol to add, such as "=:=".
- tokenType: TokenType - token type.