Azure / Azure-DataFactory

Other
480 stars 585 forks source link

Custom activity ( batch ) -> storage account failing #526

Open nawaahme opened 1 year ago

nawaahme commented 1 year ago

I'm getting blob access denied msg when Custom Activity of Data Factory is running

Operation: Custom activity trying to converts csv to excel and executing inside batch node.

{"errorCategory":0,"code":"BlobAccessDenied","message":"Access for one of the specified Azure Blob(s) is denied","details":[{"Name":"BlobSource","Value":"https://xxxxxx.blob.core.windows.net/customactxxxxx/xxxcustomactivity/ICSharpCode.SharpZipLib.dll?sv=2018-03-28&sr=b&sig=kOQqTE7jirHRQXk2ljMZ5Mmxu0BBpF9rC%2BHsZS0h3gQ%3D&st=2023-02-06T04%3A46%3A13Z&se=2023-03-08T05%3A46%3A13Z&sp=r"},{"Name":"FilePath","Value":"D:\batch\tasks\workitems\adfv2-xxxqavmpool01\job-1\da5de2e3-413e-4288-978f-e232f08316eb\wd\ICSharpCode.SharpZipLib.dll"}]}

The issue started occurring after we enabled storage account to accept traffic from specific VNET allowed ADF to connect ,Corp IP ranges and Added Batch node IP address

Azure Batch image

Batch settings image

nawaahme commented 1 year ago

we had to recreate batch node pool to resolve it