Class TokenizerHelper
Allows to split string into tokens.
public class TokenizerHelper- Inheritance
-
TokenizerHelper
Constructors
- TokenizerHelper(string, char, char)
Initialize the TokenizerHelper with the string to tokenize, the char which represents quotes and the list separator.
- TokenizerHelper(string, IFormatProvider)
Constructor for TokenizerHelper which accepts an IFormatProvider. If the IFormatProvider is null, we use the thread's IFormatProvider info. We will use ',' as the list separator, unless it's the same as the decimal separator. If it is, then we can't determine if, say, "23,5" is one number or two. In this case, we will use ";" as the separator.
Properties
- FoundSeparator
Gets whether or not the separator was found.
Methods
- GetCurrentToken()
Gets current token.
- GetNumericListSeparator(IFormatProvider)
Helper to get the numeric list separator for a given IFormatProvider. Separator is a comma [,] if the decimal separator is not a comma, or a semicolon [;] otherwise.
- LastTokenRequired()
Throws an exception if there is any non-whitespace left un-parsed.
- NextToken()
Advances to the NextToken.
- NextToken(bool)
Advances to the NextToken
- NextToken(bool, char)
Advances to the NextToken. A separator character can be specified which overrides the one previously set.
- NextTokenRequired()
Advances to the NextToken, throwing an exception if not present.
- NextTokenRequired(bool)
Advances to the NextToken, throwing an exception if not present.