ExpressionWordState

Implements a word state object.

Implements: GenericWordState

Description

The ExpressionTokenizer class allows you to implement a word state object.

Constructors

NewExpressionWordState

Constructs an instance of this class.

NewExpressionWordState() *ExpressionWordState

Fields

Supported expression keywords.

Keywords []string = []string{ “AND”, “OR”, “NOT”, “XOR”, “LIKE”, “IS”, “IN”, “NULL”, “TRUE”, “FALSE” }

NextToken

Gets the next token from the stream started from the character linked to this state.

(c *ExpressionQuoteState) NextToken(scanner IScanner, tokenizer ITokenizer) *Token

  • scanner: IScanner - textual string to be tokenized.
  • tokenizer: ITokenizer - tokenizer class that controls the process.
  • returns: *Token - next token from the top of the stream.