for example when calling the method
javalang.tokenizer.tokenize("'\"'")
the expected result would be of type literal javalang.tokenizer.Character with value '"', but the tokenizer identified it as String with value '\'"\''.
I don't know if it's a bug or if I'm calling the method the wrong way.
for example when calling the method
javalang.tokenizer.tokenize("'\"'")the expected result would be of type literaljavalang.tokenizer.Characterwith value'"', but the tokenizer identified it as String with value '\'"\''. I don't know if it's a bug or if I'm calling the method the wrong way.