CsvWordState

Implements a word state to tokenize a CSV stream.

Implements: GenericWordState

Description

The CsvWordState class implements a word state to tokenize a CSV stream.

Constructors

Constructs this object with specified parameters.

CsvWordState(field_separators: List[int], quote_symbols: List[int])

  • field_separators: List[int] - separators for fields in a CSV stream.
  • quote_symbols: List[int] - delimiter characters used to quote strings.