udpate to version = "0.15.1-dev0"

huggingface / tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

https://huggingface.co/docs/tokenizers

Apache License 2.0

8.69k stars 747 forks source link

Closed ArthurZucker closed 7 months ago

ArthurZucker commented 7 months ago

Update package version after realease

HuggingFaceDocBuilderDev commented 7 months ago

The documentation is not available anymore as the PR was closed or merged.