kubedl-io / kubedl

Run your deep learning workloads on Kubernetes more easily and efficiently.
https://kubedl.io/
Apache License 2.0
498 stars 78 forks source link

[feature request] Make cachebackend can be reused by different jobs #215

Open zjchenn opened 2 years ago

zjchenn commented 2 years ago

What would you like to be added: Enable the CacheBackend created by the previous Job can be reused by the next Job.

Why is this needed: Users can avoid creating cacheBackend repeatedly and skip the step of caching remote files, thus improving the efficiency of cacheBackend.

zjchenn commented 2 years ago

Hi, I think this feature can make CacheBackend more useful. And my preliminary design is in this PR, looking forward to discussing with you!