search

jbusecke / cmip6_derived_cloud_datasets

Prototype for derived cloud data pipeline using CMIP6 data.
1 stars 0 forks source link

Propagate Failure in flow to github actions #10

Open jbusecke opened 2 years ago

jbusecke commented 2 years ago

I just restarted the CI and noticed that all actions show a successful completion but looking into the actions themselves reveals that the prefect flow is actually failing.

I need to figure out how to properly fail out the flow execution.

Additionally I wonder if this sort of error (AWS credentials) should be tested earlier, by e.g. having definining the write bucket as an env variable and prepend a little test write action to the full processing.

jbusecke commented 2 years ago

Something like this could be helpful for now, until I am able to completely decouple the cluster creation from the execution (#12)

https://stackoverflow.com/questions/57850553/github-actions-check-steps-status

jbusecke commented 2 years ago

I am still puzzled. The prefect flow just continues (see #13 ), even with an error. I might have to implement a state handler which explicitly raises an error?