Feature run job task - Githubissues

shwen-gine commented 3 months ago

Description

Added code to support Run Job task type. Run Job task can trigger another job by its job_name

Related Issue

Link to the issue - #55

Motivation and Context

Databricks now supports creating a "Run Job" task, which can trigger another job by its job_id, its good to have this feature in brickflow

How Has This Been Tested?

Unit tests + deployed test workflow using wheel file

Screenshots (if appropriate):

Tested using brickflow-bundles-test
All test cases passed
Test workflow with a Run Job task created using whl file

Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

[x] My code follows the code style of this project.
[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.
[x] I have read the CONTRIBUTING document.
[x] I have added tests to cover my changes.
[x] All new and existing tests passed.

asingamaneni commented 3 months ago

We need to update docs. Looks like the build failed, can you please run make fmt locally and then confirm if every thing looks good with make cov. Thanks for the effort!