ExpressionWordState

Implements a word state object.

Extends: GenericWordState

Description

The ExpressionTokenizer class allows you to implement a word state object.

Constructors

Constructs an instance of this class.

public ExpressionWordState() throws Exception

Fields

Supported expression keywords.

public final String[] keywords = new String[]{ “AND”, “OR”, “NOT”, “XOR”, “LIKE”, “IS”, “IN”, “NULL”, “TRUE”, “FALSE” }

nextToken

Gets the next token from the stream started from the character linked to this state.

public Token nextToken(IScanner scanner, ITokenizer tokenizer) throws Exception

  • scanner: IScanner - textual string to be tokenized.
  • tokenizer: ITokenizer - tokenizer class that controls the process.
  • returns: Token - next token from the top of the stream.