ploomber / soopervisor

☁️ Export Ploomber pipelines to Kubernetes (Argo), Airflow, AWS Batch, SLURM, and Kubeflow.
https://soopervisor.readthedocs.io
Apache License 2.0
45 stars 18 forks source link

explain in the docs that actual k8s cluster need a pvc for sharing data #65

Open edublancas opened 2 years ago

edublancas commented 2 years ago

the current example works for local cluster but won't work for a production one, it needs to be a PVC (see an example here)

we need to ensure that this is clear and that all relevant documentation sections explain that, so users do not attempt to configure a production cluster without a pvc.