sassoftware / sas-airflow-provider

Apache Airflow Provider for creating tasks in Airflow to execute SAS Studio Flows and Jobs.
Apache License 2.0
18 stars 15 forks source link

Error Handling when job state is "cancelled" #5

Closed harkamvysis closed 1 year ago

harkamvysis commented 1 year ago

Hi All, We have stumbled across some SAS studio flows that have a built in logic to abort. However that means that the job_state is set to "canceled" rather than "failed". Perhaps we should add error handling that takes this job state into account. Right now if a flow ends with a cancelled state airflow will mark it as successful in the web interface.

A potential fix would be to add a new airflow exception when job_state == "canceled" (note that "cancelled" with double "l" wont be accepted as a valid job state"

image

Carus11 commented 1 year ago

What does the API return to denote cancelled vs the failed status? Is it surfaced as a regular json property, or a sysrc value?