Complete Tokenizer and add unit tests

LukasKalbertodt / jswag

(Not maintained anymore) Java Style Checker

MIT License

0 stars 0 forks source link

Complete Tokenizer and add unit tests #6

Closed LukasKalbertodt closed 9 years ago

LukasKalbertodt commented 9 years ago

A good point to merge back into master: The Tokenizer should now be language specification compliant (except for one minor thing). This PR also adds a bunch of unit tests for the tokenizer.

Closes #5, closes #4, closes #3, closes #2 Still unresolved, but low priority: #1