Implements a default tokenizer class.
Extends: AbstractTokenizer
Description
The GenericTokenizer allows you to implement a default tokenizer class.
Constructors
Creates an instance of GenericTokenizer
publicGenericTokenizer() throws Exception
Extends: AbstractTokenizer
The GenericTokenizer allows you to implement a default tokenizer class.
Creates an instance of GenericTokenizer
publicGenericTokenizer() throws Exception