search

allenai / cached_path

A file utility for accessing both local and remote files through a unified interface.
https://cached-path.readthedocs.io/
Apache License 2.0
35 stars 11 forks source link

Cached Folder? #197

Open fakerybakery opened 12 months ago

fakerybakery commented 12 months ago

Hi, Might it be possible to cache a folder from Hugging Face? Thanks in advance!

epwalsh commented 12 months ago

@fakerybakery do you have an example? I'll see if I can get it to work

fakerybakery commented 12 months ago

Hi, I was wondering if it might be possible to get a cached path for an entire directory, for example if I had a folder called models in Hugging Face, could I get a cached path for it? Thanks!

epwalsh commented 11 months ago

@fakerybakery so at the moment, no, but I think this would be a nice feature to have in general. We could support this with hf://, gs:// and s3:// paths.