There are a few mentions of tokenList left in Tokenizer.Tokenize and they should be renamed to remove the type "List" so that the naming conforms to the conventions of the .NET Framework.
Also, where (CliSymbol Symbol, CliTokenType TokenType)> tokens is used, the word tokens should be changed to validTokens to avoid any confusion between the list of valid tokens and the list of tokens being built up.
There are a few mentions of
tokenListleft inTokenizer.Tokenizeand they should be renamed to remove the type "List" so that the naming conforms to the conventions of the .NET Framework.Also, where
(CliSymbol Symbol, CliTokenType TokenType)> tokensis used, the wordtokensshould be changed tovalidTokensto avoid any confusion between the list of valid tokens and the list of tokens being built up.