Currently when a string starts with whitespace the tokentype of that whitespace returns nil, not string. I compared this to javascript/common lisp syntax where it does return string. Turns out it eats the spaces at the beginning of a string even though it is in string mode already.
ibdknox
commented
10 years ago
Currently when a string starts with whitespace the tokentype of that whitespace returns nil, not string. I compared this to javascript/common lisp syntax where it does return string. Turns out it eats the spaces at the beginning of a string even though it is in string mode already.