ExpressionWordState

Implements a word state object.

Extends: GenericWordState

Description

The ExpressionTokenizer class allows you to implement a word state object.

Constructors

Constructs an instance of this class.

ExpressionWordState()

Fields

Supported expression keywords.

List<String> keywords = [‘AND’, ‘OR’, ‘NOT’, ‘XOR’, ‘LIKE’, ‘IS’, ‘IN’, ‘NULL’, ‘TRUE’, ‘FALSE’]

nextToken

Gets the next token from the stream, starting from the character linked to this state.

Token? nextToken(IScanner scanner, ITokenizer? tokenizer)

  • scanner: IScanner - textual string to be tokenized.
  • tokenizer: ITokenizer? - tokenizer class that controls the process.
  • returns: Token? - next token from the top of the stream.