':' is tokenized as an OPERATOR rather than a CONSTANT

[Derek-Jones]

The character constant ':' is tokenized as an OPERATOR rather than a CONSTANT. The same incorrect behavior also occurs for the string literal ":"

x == '(' && y == ':' && z == ":" :

(x, TokenType.IDENTIFIER, (1, 1))
(==, TokenType.OPERATOR, (1, 3))
(', TokenType.SPECIAL_SYMBOL, (1, 6))
((, TokenType.CONSTANT, (1, 7))
(', TokenType.SPECIAL_SYMBOL, (1, 8))
(&&, TokenType.OPERATOR, (1, 10))
(y, TokenType.IDENTIFIER, (1, 13))
(==, TokenType.OPERATOR, (1, 15))
(', TokenType.SPECIAL_SYMBOL, (1, 18))
(:, TokenType.OPERATOR, (1, 19))
(', TokenType.SPECIAL_SYMBOL, (1, 20))
(&&, TokenType.OPERATOR, (1, 22))
(z, TokenType.IDENTIFIER, (1, 25))
(==, TokenType.OPERATOR, (1, 27))
(", TokenType.SPECIAL_SYMBOL, (1, 30))
(:, TokenType.OPERATOR, (1, 31))
(", TokenType.SPECIAL_SYMBOL, (1, 32))
(:, TokenType.OPERATOR, (1, 34))

[Dec1mo]

Thanks for informing us this bug, Derek. Unfortunately, we no longer maintain this repository. But we do welcome contributions, so you might make a PR to fix this error. Cheers!

[ngocbh]

@tranvien98 do you wanna take a look at this? I'm gonna release a new version soon. Hopefully we can get it fixed as well.