Open riking opened 6 years ago
Wow, definitely thorough :)
So do you think this should just be put alongside the existing scanner package, or should it supersede it?
@riking This pull request has some complex conflicts that need to be resolved and then we can review it. Thanks!
I needed a tokenizer that properly skipped bad-string and bad-url without erroring out, so I just rewrote the whole thing /shrug
Expanded the tests and includes fuzz testing.