studioml / studio

Studio: Simplify and expedite model building process
https://studio.ml
Apache License 2.0
379 stars 52 forks source link

Improve performance and management of workload storage handlers. #460

Closed andreidenissov-cog closed 3 years ago

andreidenissov-cog commented 3 years ago

We create storage handlers frequently for workload processing. Given that at least for S3/minio storage that involves high latency in some API calls, we need to improve overall handlers management, for example by caching already created instances.

andreidenissov-cog commented 3 years ago

Done.