Azure-Player / azure.datafactory.devops

Azure DevOps Deployment Tasks for Azure Data Factory objects
MIT License
39 stars 21 forks source link

Unknown object type: Credential #114

Closed kush316 closed 1 year ago

kush316 commented 1 year ago

Using this custom extension to publish my ADF to UAT environment but getting this error

2022-12-01T17:15:03.0101131Z ##[error]ADFT0029: Unknown object type: Credential.

I have installed all the latest modules on my ADO agent box, also to avoid this error I am excluding credential and linkedservices.json files too.

image

image

2022-12-01T17:14:21.6135496Z ##[section]Starting: Publish ADF m---01 from JSON files 2022-12-01T17:14:21.7357504Z ============================================================================== 2022-12-01T17:14:21.7358570Z Task : Publish Azure Data Factory 2022-12-01T17:14:21.7359179Z Description : Deploys entire ADF (v2) from JSON files to ADF instance (adftools) 2022-12-01T17:14:21.7359567Z Version : 1.14.1173 2022-12-01T17:14:21.7359990Z Author : Kamil Nowinski (SQLPlayer) 2022-12-01T17:14:21.7360722Z Help : More Information 2022-12-01T17:14:21.7361265Z ============================================================================== 2022-12-01T17:14:25.6144883Z PowerShell: 5.1.19041.1682 Desktop 2022-12-01T17:14:50.5560251Z Added TLS 1.2 in session. 2022-12-01T17:14:51.9959278Z ##[command]Import-Module -Name C:\Users\tdevsvd\Documents\PowerShell\Modules\Az.Accounts\2.10.3\Az.Accounts.psd1 -Global 2022-12-01T17:14:53.7272328Z ##[command]Clear-AzContext -Scope Process 2022-12-01T17:14:56.7041751Z ##[command]Clear-AzContext -Scope CurrentUser -Force -ErrorAction SilentlyContinue 2022-12-01T17:14:56.9207902Z ##[command]Connect-AzAccount -ServicePrincipal -Tenant 66f05666-5faf-4497-99ba-2265c92ebdd5 -Credential System.Management.Automation.PSCredential -Environment AzureCloud @processScope 2022-12-01T17:15:00.0521071Z ##[command] Set-AzContext -SubscriptionId 1a29696e-3528-4688-b1d2-d2c57c515e6d -TenantId 66f05666-5faf-4497-99ba-2265c92ebdd5 2022-12-01T17:15:01.1672080Z 0 rule(s)/object(s) added to be included in deployment. 2022-12-01T17:15:01.1853304Z 2 rule(s)/object(s) added to be excluded from deployment. 2022-12-01T17:15:01.2099644Z ====================================================================================== 2022-12-01T17:15:01.2117834Z ### azure.datafactory.tools Version 0.97.000 ### 2022-12-01T17:15:01.2129848Z ====================================================================================== 2022-12-01T17:15:01.2142150Z Invoking Publish-AdfV2FromJson (https://github.com/SQLPlayer/azure.datafactory.tools) 2022-12-01T17:15:01.2154136Z with the following parameters: 2022-12-01T17:15:01.2165406Z ====================================================================================== 2022-12-01T17:15:01.2179437Z RootFolder: C:\Users\tdevsvd\Downloads\vsts-agent-win-x64-2.213.2_work\r3\a_TML-ADF 2022-12-01T17:15:01.2192892Z ResourceGroupName: m-** 2022-12-01T17:15:01.2204844Z DataFactoryName: m-**** 2022-12-01T17:15:01.2222652Z Location: EastUS2 2022-12-01T17:15:01.2234972Z Stage: C:\Users\tdevsvd\Downloads\vsts-agent-win-x64-2.213.2_work\r3\a_TML-ADF\deploymentConfig\config-uat.csv 2022-12-01T17:15:01.2259409Z Options provided: True 2022-12-01T17:15:01.2271224Z Publishing method: AzResource 2022-12-01T17:15:01.2325231Z Is Dry Run?: False 2022-12-01T17:15:01.2338490Z ====================================================================================== 2022-12-01T17:15:01.2383563Z Publish options are provided. 2022-12-01T17:15:01.2397049Z STEP: Verifying whether ADF exists... 2022-12-01T17:15:02.3513857Z Azure Data Factory exists. 2022-12-01T17:15:02.3546316Z =================================================================================== 2022-12-01T17:15:02.3562004Z STEP: Reading Azure Data Factory from JSON files... 2022-12-01T17:15:02.5311017Z IntegrationRuntimes: 1 object(s) loaded. 2022-12-01T17:15:03.0101131Z ##[error]ADFT0029: Unknown object type: Credential. 2022-12-01T17:15:03.0990321Z ##[section]Finishing: Publish ADF **** from JSON files

kush316 commented 1 year ago

Seems extension is using this old adftools "2022-12-01T17:15:01.2117834Z ### azure.datafactory.tools Version 0.97.000 ###", how can I force it to use version 99 or above to avoid issue with credential?

NowinskiK commented 1 year ago

Yes, that's correct. The extension has not been updated to the latest version and you can't enforce it. The update will take place in the next couple of days.

mig-sre commented 1 year ago

Hi Kamil,

I am facing the same issue with the objects referencing credentials, do you have a tentative date for the update of the extension to version 0.99 of the PowerShell module?

Thank you

NowinskiK commented 1 year ago

Yes, I know exact date now - it will be tonight where PowerShell module of #adftools will be updated to the latest version (0.110)

NowinskiK commented 1 year ago

Fixed in ver.1.15.1239, just released.

kush316 commented 1 year ago

Fixed in ver.1.15.1239, just released.

Thanks so much Kamil for the prompt response.

kush316 commented 1 year ago

It's working awesome

image