This state will either delegate to a comment-handling state, or return a token with just a slash in it.
Description
The CCommentState class allows you to create a state that will either delegate to a comment-handling state, or return a token with just a slash in it.
Instance methods
nextToken
Either delegates to a comment-handling state, or returns a token with just a slash in it.
@override
Token? nextToken(IScanner scanner, ITokenizer? tokenizer)
- scanner: IScanner - text string to be tokenized.
- tokenizer: ITokenizer? - tokenizer class that controls the process.
- returns: Token? - next token from the top of the stream.