We were running into a problem with our azure data factory. It can not handle changes in the data model, while not all deltas have been processed yet. So we either (1) need to avoid datamodel changes while we have still have deltas or (2) remove the existing deltas.
Looking to towards the code, for Microsoft Fabric Storage Type a functionality simular to the second option is already present. This pull request extends the functionality for deleting tables with the handling of Azure Data Lake.
We were running into a problem with our azure data factory. It can not handle changes in the data model, while not all deltas have been processed yet. So we either (1) need to avoid datamodel changes while we have still have deltas or (2) remove the existing deltas.
Looking to towards the code, for Microsoft Fabric Storage Type a functionality simular to the second option is already present. This pull request extends the functionality for deleting tables with the handling of Azure Data Lake.