search

cncf / research-user-group

📚 👨‍🔬 👩‍🔬 Discussion and advancement of Research Computing using Cloud Native technologies
75 stars 19 forks source link

[CNRWB] DataOps #26

Closed mrbobbytables closed 3 years ago

mrbobbytables commented 4 years ago

Managing data in a Cloud Native environment has its own set of challenges that are fundamentally different from "classic" HPC environments. There is much more reliance on object storage etc. What are the best practices around this change? How do you manage the lifecycle of data?

This could be expanded more into the operations category for on-prem deployments of ceph or grouped in with the parallel filesystems a bit.

rochaporto commented 3 years ago

We're closing these tickets for now, as we work in recipes for topics coming out of the regular meetings. Can check later if it makes sense to pick it up again.