search

ropensci / tokenizers

Fast, Consistent Tokenization of Natural Language Text
https://docs.ropensci.org/tokenizers
Other
184 stars 25 forks source link

Fix encoding issues on Windows #60

Closed lmullen closed 6 years ago

lmullen commented 6 years ago

Fixes #58

Thanks especially to @patperry

codecov-io commented 6 years ago

Codecov Report

Merging #60 into master will decrease coverage by 0.32%. The diff coverage is 100%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master      #60      +/-   ##
==========================================
- Coverage    90.5%   90.17%   -0.33%     
==========================================
  Files          13       12       -1     
  Lines         358      346      -12     
==========================================
- Hits          324      312      -12     
  Misses         34       34
Impacted Files Coverage Δ
src/skip_ngrams.cpp 97.61% <100%> (-0.06%) :arrow_down:
src/shingle_ngrams.cpp 100% <100%> (ø) :arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update cb75ac4...45207f8. Read the comment docs.