SymbolNode

Constructs a SymbolNode.

Description

The SymbolNode class allows you to construct a SymbolNode.

Important points

  • A SymbolNode object is a member of a tree that contains all possible prefixes of allowable symbols. Multi-character symbols appear in a SymbolNode tree with one node for each character.
  • For example, the symbol =:~ will appear in a tree as three nodes. The first node contains an equals sign and has a child. That child contains a colon and has a child. This third child contains a tilde, and has no children of its own. If the colon node had another child for a dollar sign character, then the tree would contain the symbol =:$.
  • A tree of SymbolNode objects collaborate to read a (potentially multi-character) symbol from an input stream. A root node with no character of its own finds an initial node that represents the first character in the input. This node looks to see if the next character in the stream matches one of its children. If so, the node delegates its reading task to its child.
  • This approach walks down the tree, pulling symbols from the input that match the path down the tree.
  • When a node does not have a child that matches the next character, we will have read the longest possible symbol prefix. This prefix may or may not be a valid symbol.
  • Consider a tree that has had =:~ added and has not had =: added. In this tree, of the three nodes that contain =:~, only the first and third contain complete symbols. If, say, the input contains =:a, the colon node will not have a child that matches the ‘a’ and so it will stop reading. The colon node has to “unread”: it must push back its character, and ask its parent to unread. Unreading continues until it reaches an ancestor that represents a valid symbol.

Constructors

Constructs a SymbolNode with the given parent, representing the given character.

public SymbolNode(SymbolNode parent, char character)

  • parent: SymbolNode - node’s parent
  • character: char - node’s associated character.

Properties

TokenType

Token type

public TokenType TokenType { get; set; }

Valid

Boolean variable

internal bool Valid { get; set; }

Instance methods

AddDescendantLine

Adds a line of descendants that represents the characters in the given string.

internal void AddDescendantLine(string value, TokenType tokenType)

  • value: string - given string
  • tokenType: TokenType - token type

Ancestry

Shows the symbol this node represents.

public string Ancestry()

  • returns: string - symbol this node represents.

DeepestRead

Establishes characters in the given range as valid characters for the part of a word after the first character. Note that the tokenizer must determine which characters are valid as the beginning character of a word.

internal SymbolNode DeepestRead(IScanner scanner)

EnsureChildWithChar

Finds or creates a child for the given character.

internal SymbolNode EnsureChildWithChar(char value)

  • value: char - chararacters’s value
  • returns: SymbolNode - symbol’s node

FindChildWithChar

Finds a child with the given character.

internal virtual SymbolNode FindChildWithChar(char value)

  • value: char - value
  • returns: SymbolNode - symbol’s node

UnreadToValid

Unwinds to a valid node. This node is “valid” if its ancestry represents a complete symbol. If this node is not valid, puts back the character and asks the parent to unwind.

internal SymbolNode UnreadToValid(IScanner scanner)