Implements a default tokenizer class.
Extends: AbstractTokenizer
Description
The GenericTokenizer allows you to implement a default tokenizer class.
Constructors
Creates an instance of GenericTokenizer.
publicGenericTokenizer()
Extends: AbstractTokenizer
The GenericTokenizer allows you to implement a default tokenizer class.
Creates an instance of GenericTokenizer.
publicGenericTokenizer()