search

mrpaulandrew / procfwk

A cross tenant metadata driven processing framework for Azure Data Factory and Azure Synapse Analytics achieved by coupling orchestration pipelines with a SQL database and a set of Azure Functions.
https://mrpaulandrew.com/category/azure/data-factory/adf-procfwk/
Other
185 stars 116 forks source link

Add Support for Framework Controlled Pipeline Cancellations of Workers #85

Open mrpaulandrew opened 3 years ago

mrpaulandrew commented 3 years ago

As part of the infant pipeline iterations. If the metadata current execution table is updated with a special cancellation state.

Perform a controlled cancellation of worker pipelines as part of a side affecting parent process.

mrpaulandrew commented 3 years ago

Azure Function created to cancel pipelines.