upgrade deps, improve HF downloads

allenai / cached_path

A file utility for accessing both local and remote files through a unified interface.

https://cached-path.readthedocs.io/

Apache License 2.0

35 stars 12 forks source link

upgrade deps, improve HF downloads #144

Closed epwalsh closed 1 year ago

epwalsh commented 1 year ago

General dependency upgrades and improve how we download resources from HF hub. Now we just delegate the to huggingface_hub completely so that if you don't end up with duplicate downloads of the same objects from HF.