search

leap-stc / data-management

Collection of code to manually populate the persistent cloud bucket with data
https://catalog.leap.columbia.edu/
Apache License 2.0
0 stars 5 forks source link

Limit caching concurrency for climsim recipe #44

Closed cisaacstern closed 11 months ago

cisaacstern commented 11 months ago

Installs pangeo-forge-recipes from https://github.com/pangeo-forge/pangeo-forge-recipes/pull/557 and sets the max_concurrency arg added by that PR to limit the number of simultaneous requests to Hugging Face. Hopefully a solution for #36.