bzick / tokenizer

Tokenizer (lexer) for golang
MIT License
98 stars 6 forks source link

Handle some special characters as a part of TokenKeyword #8

Closed bzick closed 1 year ago

bzick commented 1 year ago

Issue #6: allows set keywords symbols

codecov-commenter commented 1 year ago

Codecov Report

Attention: 16 lines in your changes are missing coverage. Please review.

Comparison is base (e2c2e93) 82.80% compared to head (4e2bf09) 83.45%.

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #8 +/- ## ========================================== + Coverage 82.80% 83.45% +0.64% ========================================== Files 5 5 Lines 692 713 +21 ========================================== + Hits 573 595 +22 - Misses 87 88 +1 + Partials 32 30 -2 ``` | [Files](https://app.codecov.io/gh/bzick/tokenizer/pull/8?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Ivan+Shalganov) | Coverage Δ | | |---|---|---| | [stream.go](https://app.codecov.io/gh/bzick/tokenizer/pull/8?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Ivan+Shalganov#diff-c3RyZWFtLmdv) | `82.88% <ø> (ø)` | | | [parser.go](https://app.codecov.io/gh/bzick/tokenizer/pull/8?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Ivan+Shalganov#diff-cGFyc2VyLmdv) | `86.09% <66.66%> (+0.23%)` | :arrow_up: | | [token.go](https://app.codecov.io/gh/bzick/tokenizer/pull/8?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Ivan+Shalganov#diff-dG9rZW4uZ28=) | `78.57% <83.33%> (+8.87%)` | :arrow_up: | | [tokenizer.go](https://app.codecov.io/gh/bzick/tokenizer/pull/8?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Ivan+Shalganov#diff-dG9rZW5pemVyLmdv) | `82.60% <50.00%> (-5.20%)` | :arrow_down: |

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.