IWhitespaceState

Defines an interface for tokenizer states that processes whitespaces (' ‘, ‘\t’).

Inherits: ITokenizerState

Description

The IWhitespaceState interface is used by tokenizer states that process whitespaces (' ‘, ‘\t’).

Instance methods

ClearWhitespaceChars

Clears definitions of whitespace characters.

void ClearWhitespaceChars()

SetWhitespaceChars

Establishes the given characters as whitespace to ignore.

void SetWhitespaceChars(char fromSymbol, char toSymbol, bool enable)

  • fromSymbol: char - first character index of the interval.
  • toSymbol: char - last character index of the interval.
  • enable: bool - true if this state should ignore characters in the given range.