ExpressionWordState

Implements a word state object.

Inherits: GenericWordState

Description

The ExpressionTokenizer class allows you to implement a word state object.

Constructors

Constructs an instance of this class.

public ExpressionWordState()

Fields

Supported expression keywords.

public string[] Keywords = new string[] { “AND”, “OR”, “NOT”, “XOR”, “LIKE”, “IS”, “IN”, “NULL”, “TRUE”, “FALSE” };

NextToken

Gets the next token from the stream started from the character linked to this state.

public override Token NextToken(IScanner scanner, ITokenizer tokenizer)

  • scanner: IScanner - textual string to be tokenized.
  • tokenizer: ITokenizer - tokenizer class that controls the process.
  • returns: Token - next token from the top of the stream.