search

ploomber / soopervisor

☁️ Export Ploomber pipelines to Kubernetes (Argo), Airflow, AWS Batch, SLURM, and Kubeflow.
https://soopervisor.readthedocs.io
Apache License 2.0
45 stars 18 forks source link

Airflow example change #54

Closed idomic closed 2 years ago

idomic commented 2 years ago

@edublancas check it out, added a fix on top of the docker file tested with and without a ~/.ploomber home dir.

edublancas commented 2 years ago

this is failing because it depends on the unreleased ploomber version right?

idomic commented 2 years ago

Yeah reran it, I wasn't sure how to incorporate Slurm and Lambda

idomic commented 2 years ago

@edublancas any updates on this?

edublancas commented 2 years ago

also, since this depends on a newer ploomber version, this needs updates: https://github.com/ploomber/soopervisor/blob/2d6315baa34703692f768d9067808dcafcc41943/setup.py#L32

for version >=0.14.6