Defines an interface for tokenizer state that processes whitespaces (' ‘, ‘\t’).
Extends: ITokenizerState
Description
The IWhitespaceState interface is used by TokenizerStates that process whitespaces (' ‘, ‘\t’).
Instance methods
clearWhitespaceChars
Clears definitions of whitespace characters.
clearWhitespaceChars(): void
setWhitespaceChars
Establish the given characters as whitespace to ignore.
setWhitespaceChars(fromSymbol: number, toSymbol: number, enable: boolean): void
- fromSymbol: number - first character index of the interval.
- toSymbol: number - last character index of the interval.
- enable: boolean - true if this state should ignore characters in the given range.