feat(propagation): add new capabilities and guardrails

acryldata / datahub-actions

DataHub Actions is a framework for responding to changes to your DataHub Metadata Graph in real time.

42 stars 47 forks source link

Closed shirshanka closed 1 month ago

shirshanka commented 1 month ago

This PR

adds a few configurable guardrails to ensure docs propagation is
- rate-limited in terms of derived writes
- respects maximum fan out constraints per hop
- respects maximum depth constraints
adds capability for propagating metadata both upstream and downstream
adds and improves smoke testing capabilities

github-actions[bot] commented 1 month ago

63 tests ±0 63 :white_check_mark: ±0 4s :stopwatch: ±0s 1 suites ±0 0 :zzz: ±0 1 files ±0 0 :x: ±0

Results for commit b78db489. ± Comparison against base commit e255961e.

:recycle: This comment has been updated with latest results.