Tokenise before feeding to our parser, and avoid `spaces()` and reduce `attempts`

[afsalthaj]

This will also help us reduce even more number of attempts and backtracking!

[jdegoes]

To avoid making the end-user suffer for our convenience, the tokenizer must keep track of line/column numbers (actually, ranges, per token), so that errors can have sensible and contextual reporting.