ploomber / soopervisor

☁️ Export Ploomber pipelines to Kubernetes (Argo), Airflow, AWS Batch, SLURM, and Kubeflow.
https://soopervisor.readthedocs.io
Apache License 2.0
45 stars 18 forks source link

document that hooks are not supported #107

Open edublancas opened 2 years ago

edublancas commented 2 years ago

Ploomber allows users to execute functions after a task/dag finishes/fails (hooks). However, this logic is implemented in the Ploomber local executor and gets lost when exporting to other platforms.

We should document this behavior in the code: if we detect that the loaded pipeline contains hooks, print a warning saying it's not supported.