Closed AlanAboudib closed 3 years ago
Default tokenization rules were not working when creating a tokenizer with default arguments
Check out this pull request on
See visual diffs & provide feedback on Jupyter Notebooks.
Powered by ReviewNB
Default tokenization rules were not working when creating a tokenizer with default arguments