Bertverbeek4PS / bc2adls

Exporting data from Dynamics 365 Business Central to Azure data lake storage or MS Fabric lakehouse
MIT License
60 stars 22 forks source link

Exporting to multiple target Azure Storage Accounts? #168

Closed x3N1GM4x closed 2 months ago

x3N1GM4x commented 2 months ago

Is it possible to have bc2adls export to multiple Storage Accounts, or deploy it multiple times to the same BC environment with each deployment pointing at a different target Storage Account?

Bertverbeek4PS commented 2 months ago

Hi @x3N1GM4x you cannot deploy multiple times the extension in one single environment. What kind of scenario do you want? Because most of the time you want to export it to only one Storage Account or Onelake

x3N1GM4x commented 2 months ago

Hi @Bertverbeek4PS, thanks so much for the quick response.

Our scenario is that we're in a transitional period after being acquired and while we had bc2adls working fine pre-acquisition, outputting to our chosen Storage Account and then being processed from there into our Data Warehouse, we now need to output the same data in parallel to a Storage Account owned by the acquiring business, so they can begin ingesting the same source data into their Data Warehouse.

If there's no way to do this with bc2adls itself then we'll have to instead put another process in place to copy the data from one location to the other, which is not a big problem, but just requires a few more things to move at our end, so we wanted to check first there was not some easier solution.

Bertverbeek4PS commented 2 months ago

Hi @x3N1GM4x no sorry. In bc2adls there is no support of to multiple storage accounts. I think it is easier to just copy the data in the pipeline that is already there. So at the final stage in the pipeline you will store it in your own storage account and the one owned by the acquiring business.