Tokenizer Constructor (String, String, Boolean)

Initializes a new class instance with a specified string to process, the specified token delimiters to use, and whether the delimiters must be included in the results.

public Tokenizer(
   string source,
   string delimiters,
   bool includeDelims
);