acryldata / datahub-actions

DataHub Actions is a framework for responding to changes to your DataHub Metadata Graph in real time.
42 stars 47 forks source link

feat(actions): add docs propagation action for columns #130

Closed shirshanka closed 1 month ago

shirshanka commented 1 month ago

This PR introduces a new DocPropagationAction for column-level documentation propagation.

Key features include:

  1. Automated propagation of documentation changes to downstream and sibling schema fields
  2. Configuration options to enable/disable propagation at global and column levels
  3. Support for ADD, MODIFY, and REMOVE operations on documentation
  4. Integration with DataHub's event system, processing EntityChangeEvents and MetadataChangeLogs
  5. Ability to fetch and apply global settings from DataHub
  6. Detailed logging and statistics tracking for monitoring and debugging

As seen in DataHub townhall - https://youtu.be/hdqgjxiW-zI?t=2051

github-actions[bot] commented 1 month ago

Unit Test Results (build & test)

63 tests  ±0   63 :white_check_mark: ±0   4s :stopwatch: ±0s  1 suites ±0    0 :zzz: ±0   1 files   ±0    0 :x: ±0 

Results for commit 6fc4fb69. ± Comparison against base commit c5f6dba9.

:recycle: This comment has been updated with latest results.