Fix issue with /* */ comment cases in cpp_tokenizer.py

BK-SCOSS / sctokenizer

A Source Code Tokenizer

MIT License

14 stars 5 forks source link

Closed xTrimy closed 2 years ago

xTrimy commented 2 years ago

In the previous pull request #8, I forgot to skip / in the case of /* */

I modified the cur == '*' case to skip 2 tokens instead of 1 (i+=2)

xTrimy commented 2 years ago

@Dec1mo Could you please review this?

Dec1mo commented 2 years ago

Thanks, @xTrimy. LGTM!