Defines an interface for tokenizer states that processes whitespaces (' ‘, ‘\t’).
Inherits: ITokenizerState
Description
The IWhitespaceState interface is used by tokenizer states that process whitespaces (' ‘, ‘\t’).
Instance methods
ClearWhitespaceChars
Clears definitions of whitespace characters.
void ClearWhitespaceChars()
SetWhitespaceChars
Establishes the given characters as whitespace to ignore.
void SetWhitespaceChars(char fromSymbol, char toSymbol, bool enable)
- fromSymbol: char - first character index of the interval.
- toSymbol: char - last character index of the interval.
- enable: bool - true if this state should ignore characters in the given range.