search

huggingface / tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
https://huggingface.co/docs/tokenizers
Apache License 2.0
8.92k stars 776 forks source link

Switch from `cached_download` to `hf_hub_download` in tests #1547

Closed Wauplin closed 3 months ago

Wauplin commented 3 months ago

Small PR to switch from the legacy cached_download to hf_hub_download in tests. Doesn't impact the lib' itself.

(somehow related to https://github.com/huggingface/huggingface_hub/pull/2317)

HuggingFaceDocBuilderDev commented 3 months ago

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Wauplin commented 3 months ago

@ArthurZucker Thanks for the review :)

Can you just rebase, should fix the CI

Done :heavy_check_mark: