Defines an interface for tokenizer states that process delimiters.
Inherits: ITokenizerState
Description
The ISymbolState interface is used for tokenizer states that process delimiters.
Instance methods
Add
Add a multi-character symbol.
void Add(string value, TokenType tokenType)
- value: string - symbol to add, such as "=:=".
- tokenType: TokenType - token type.