Namespace InteractiveReadLine.Tokenizing
Classes
- CommonLexers
Provides ready-made lexers and components for creating custom lexers. A lexer splits a line into tokens used by auto-completion and token-based formatters.
- RegexTokenDef
Defines a token type for a regular-expression parser. The definition contains a matching pattern, automatically anchored with ^ when necessary, and an optional type code for matching tokens.
- TokenizedLine
The TokenizedLine class represents a line of text processed by a lexer and split into a sequence of tokens.
Interfaces
- IToken
A contract for a single token produced from a line of text by a lexer.