ploomber / soopervisor

☁️ Export Ploomber pipelines to Kubernetes (Argo), Airflow, AWS Batch, SLURM, and Kubeflow.
https://soopervisor.readthedocs.io
Apache License 2.0
45 stars 18 forks source link

better errors in soopervisor #73

Open edublancas opened 2 years ago

edublancas commented 2 years ago

we use pydantic to validate the soopervisor.yaml file schema, however, the error messages aren't clear. so we should customize them (we already did something similar in ploomber, so we could borrow some code from there).

Furthermore, we should add some logic to help them quickly identify typos. example, if they have mounted_volume instead of mounted_volumes, we can use difflib for that https://docs.python.org/3/library/difflib.html#difflib.get_close_matches