This fixes a few different bugs in the scanner; I left them as different patches to make it more obvious what work has been done. If you'd prefer they be a single patch just let me know. I also fixed the test suite (which was just crashing) and updated it to check the values the scanner returns as well as ensure that all of the input was consumed by scanning.
kisielk
commented
9 years ago
This fixes a few different bugs in the scanner; I left them as different patches to make it more obvious what work has been done. If you'd prefer they be a single patch just let me know. I also fixed the test suite (which was just crashing) and updated it to check the values the scanner returns as well as ensure that all of the input was consumed by scanning.