Closed gardners closed 3 years ago
Fixed page-wrap problem.
Now most tokens work, except oddly (and perhaps cooincidentally) TAB( doesn't match.
Verify all others, and figure out cause.
Position in the list doesn't seem to affect it. Also all the single-character math operators and relational operators don't get detected.
Also confirmed it is not the word boundary check that it is failing. It just seems to not match it. However the string it compresses to matches what compress_text.c compressed it to originally. Presumably there is some subtle bug in there.
The math operators might be getting too many end byte sequences on the end of their sequences in pack_word.
Since the bug report was issued, the tokeniser has been rewritten. Current one seems to handle "TAB(" correctly (produces same results as original C64 ROM tokeniser), display issues seems to be solved too.
All keywords after TAB( when displayed are wrong.
To reproduce, type the keyword in direct mode on a line by itself. It should echo back out verbatim.