issues
search
ml-explore
/
mlx-data
Efficient framework-agnostic data loading
MIT License
362
stars
40
forks
source link
Improves AWSFileFetcher
#59
Closed
andresy
closed
6 months ago
andresy
commented
6 months ago
AWSFileFetcher will not download a file already present on local disk
FileFetcher::erase(filename) erases filename from the cache / local disk
AWSFileFetcher::update_credentials() updates the AWS S3 client with provided credentials
AWSFileFetcher::update_credentials_with_callback() allows to update credentials via a callback...
when credentials are outdated
every given period of time