search

Nike-Inc / brickflow

Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
https://engineering.nike.com/brickflow/
Apache License 2.0
183 stars 39 forks source link

[FEATURE] Runtime Timeout Warning Notifications not implemented #57

Closed brent-johnson closed 10 months ago

brent-johnson commented 10 months ago

Is your feature request related to a problem? Please describe. JobsHealth and JobsHealthRules are implemented in the Bundles Model but are missing from Brickflows Util Core (src/core/brickflow_utils.py) this means that Brickflow cannot be used to implement runtime timeout warning notifications.

Cloud Information

Describe alternatives you've considered The alternative to this would be to not use brickflow Additional context health: Optional[JobsHealth] = None

brent-johnson commented 10 months ago

Submitted https://github.com/Nike-Inc/brickflow/pull/58 for review