Open clord opened 8 years ago
This should be quite straight-forward. Some types of string are multi-line, and so when the multiline string is detected it should tokenize as such. Might be a good idea to tokenize to another token type, depends on the situation on the ground.
This should be quite straight-forward. Some types of string are multi-line, and so when the multiline string is detected it should tokenize as such. Might be a good idea to tokenize to another token type, depends on the situation on the ground.