search

Azure / Azure-DataFactory

Other
481 stars 585 forks source link

deserialization error #506

Open SashaRisner opened 1 year ago

SashaRisner commented 1 year ago

https://github.com/Azure/Azure-DataFactory/blob/676ff9b8d2e069c0db5f1c045edd8067b57e5370/SamplesV2/ContinuousIntegrationAndDelivery/PrePostDeploymentScript.Ver2.ps1#L89

Running agent with windows-latest and latest powershell version for task with Use PowerShell Core On. I'm receiving an error re: deserialization at line 89.

soma-ms commented 1 year ago

@SashaRisner - This is not the same as the other deserialization errors reported here for the script, so the PS version doesn't matter. As the error is from standalone command Get-AzDataFactoryV2Pipeline, I suspect there might be an invalid pipeline in your factory. Please pass the -debug switch to the standalone command to get error details.

SashaRisner commented 1 year ago

@SashaRisner - This is not the same as the other deserialization errors reported here for the script, so the PS version doesn't matter. As the error is from standalone command Get-AzDataFactoryV2Pipeline, I suspect there might be an invalid pipeline in your factory. Please pass the -debug switch to the standalone command to get error details.

Thank you, I will check that!

What would an 'invalid pipeline' look like?

SashaRisner commented 1 year ago

@SashaRisner - This is not the same as the other deserialization errors reported here for the script, so the PS version doesn't matter. As the error is from standalone command Get-AzDataFactoryV2Pipeline, I suspect there might be an invalid pipeline in your factory. Please pass the -debug switch to the standalone command to get error details.

I've gone through each pipeline individually and located the pipeline which cannot be deserialized. I removed code, one item at a time until I identified the particular item causing the issue.

In one of the copy data activities I have set the Source "Read behavior" to dynamic content, below. The pipeline has been running in production for months now and the code works. It appears that Get-AzDataFactoryV2Pipeline does not support deserializing this logic. Any ideas how to get this supported/corrected?

@if(equals(pipeline().parameters.IsIncremental, bool(true)), 'queryAll', 'query')

SashaRisner commented 1 year ago

I've submit an issue to Az Powershell github.