Is your feature request related to a problem? Please describe.
Databricks now supports creating a "Run Job" task, which can trigger another job by its job_id. It would be nice to have this feature in BrickFlow.
Cloud Information
[x] AWS
[ ] Azure
[ ] GCP
[ ] Other
Describe the solution you'd like
Add a new run_job_task type. It would be nice to have something like this:
Is your feature request related to a problem? Please describe. Databricks now supports creating a "Run Job" task, which can trigger another job by its job_id. It would be nice to have this feature in BrickFlow.
Cloud Information
Describe the solution you'd like Add a new run_job_task type. It would be nice to have something like this:
Describe alternatives you've considered I've looked at invoking dependent jobs with the Databricks API
Additional context