Address infinite loop in skip_over_whitespace

[MatthiasValvekens]

Also make sure that the behaviour with EOLs at EOF is consistent.

Fixes #236

Description of the changes

Describe the changes in this PR, with references to issues in the issue tracker and forum discussions (if applicable).

Checklist

Please go over this checklist to increase the chances of your PR being worked on in a timely manner. Deviations are allowed with proper justification (see previous section).

• [x] I have read the project's CoC and contribution guidelines.
• [x] I understand and agree to the terms in the Developer Certificate of Origin as applied to this contribution.
• [x] All new code in this PR has full test coverage.

For bug fixes (delete if not applicable)

• [x] My changes do not affect any public API or CLI semantics.
• [x] My PR adds regression tests (i.e. tests that fail if the bug fix is not applied).
• [x] All new code in this PR has full test coverage.