Defines an interface for tokenizer state that processes whitespaces (' ‘, ‘\t’).
Extends: ITokenizerState
Description
The IWhitespaceState interface is used by TokenizerStates that process whitespaces (' ‘, ‘\t’).
Instance methods
clearWhitespaceChars
Clears definitions of whitespace characters.
void clearWhitespaceChars()
setWhitespaceChars
Establish the given characters as whitespace to ignore.
void setWhitespaceChars(int fromSymbol, int toSymbol, boolean enable) throws Exception
- fromSymbol: int - first character index of the interval.
- toSymbol: int - last character index of the interval.
- enable: boolean - true if this state should ignore characters in the given range.