azcopy breaks pipeline tasks

[jrudley]

AZcopy does not take in account key anymore which breaks the pipeline. I'll eventually get to submitting a PR, but a quick fix is below

`

• task: AzureCLI@2 displayName: 'SETUP: Transfer JMeter Files to Storage Account' inputs: azureSubscription: $(AZURE_SERVICE_CONNECTION_NAME) scriptType: 'bash' workingDirectory: ./terraform scriptLocation: 'inlineScript' inlineScript: | SHARENAME=$(terraform output storage_file_share_name) ACCOUNTNAME=$(terraform output storage_account_name) STGKEY=$(terraform output storage_account_key) az storage file upload-batch --account-key $STGKEY --account-name $ACCOUNTNAME --destination $SHARENAME --source $(JMETER_DIRECTORY_INPUT) `

`

• task: AzureCLI@2 displayName: 'RESULTS: Download Jmeter results' inputs: azureSubscription: $(AZURE_SERVICE_CONNECTION_NAME) scriptType: 'bash' workingDirectory: ./terraform scriptLocation: 'inlineScript' inlineScript: | RG=$(terraform output resource_group_name) SHARENAME=$(terraform output storage_file_share_name) STGKEY=$(terraform output storage_account_key) ACCOUNTNAME=$(terraform output storage_account_name)
  mkdir $(System.DefaultWorkingDirectory)/results az storage file download-batch --account-key $STGKEY --account-name $ACCOUNTNAME --destination $(JMETER_DIRECTORY_OUTPUT) --no-progress --source $SHARENAME `

[willfell]

@jrudley I've been trying to find a fix for the past week so this is awesome. Thank you!

Before it's solved for me I am undergoing an issue on the upload portion. ERROR: Client-Request-ID=4d01f112-8060-11eb-bc86-000d3af5de63 Retry policy did not allow for a retry: , HTTP status code=Unknown, Exception=HTTPSConnectionPool(host='%22dvtdevstorage92964a8f%22.file.core.windows.net', port=443): Max retries exceeded with url: /%22dvtdevshare%22/ComplicatedLoad_100.jmx (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f44df9f12b0>: Failed to establish a new connection: [Errno -2] Name or service not known',)). ERROR: HTTPSConnectionPool(host='%22dvtdevstorage92964a8f%22.file.core.windows.net', port=443): Max retries exceeded with url: /%22dvtdevshare%22/ComplicatedLoad_100.jmx (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f44df9f12b0>: Failed to establish a new connection: [Errno -2] Name or service not known',))

Would you happen to know what could be causing this?

[jrudley]

Hrm, you are using terraform to create the storage account, right? Any weird characters or spacing issues in your tf variables? Using a hosted agent pool? After my fix, I've ran pipeline around 20 times today with no issues.

On Mon, Mar 8, 2021, 4:52 PM will_fell notifications@github.com wrote:

@jrudley https://github.com/jrudley I've been trying to find a fix for the past week so this is awesome. Thank you!

Before it's solved for me I am undergoing an issue on the upload portion. ERROR: Client-Request-ID=4d01f112-8060-11eb-bc86-000d3af5de63 Retry policy did not allow for a retry: , HTTP status code=Unknown, Exception=HTTPSConnectionPool(host='%22dvtdevstorage92964a8f% 22.file.core.windows.net', port=443): Max retries exceeded with url: /%22dvtdevshare%22/ComplicatedLoad_100.jmx (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f44df9f12b0>: Failed to establish a new connection: [Errno -2] Name or service not known',)). ERROR: HTTPSConnectionPool(host='%22dvtdevstorage92964a8f% 22.file.core.windows.net', port=443): Max retries exceeded with url: /%22dvtdevshare%22/ComplicatedLoad_100.jmx (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f44df9f12b0>: Failed to establish a new connection: [Errno -2] Name or service not known',))

Would you happen to know what could be causing this?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/Azure-Samples/jmeter-aci-terraform/issues/58#issuecomment-793144636, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAOYISZ7KLVNOW5HBDKJYNLTCVIJFANCNFSM4Y2DOAFQ .

[jrudley]

azure-pipelines.load-test.yml (2).txt

[willfell]

Thanks for uploading the file. Ours is configured the same, using the outputs of the terraform deployment. Going to try some things and will come back if I'm able to find a fix.

[willfell]

I took out the terraform installer step which is why I was getting that issue. Putting that step back into it resolved the issue and it's now uploading / downloading. Thank you again @jrudley !

[jrudley]

Cool, glad you got it figured out

On Mon, Mar 8, 2021, 6:07 PM will_fell notifications@github.com wrote:

I took out the terraform installer step which is why I was getting that issue. Putting that step back into it resolved the issue and it's now uploading / downloading. Thank you again @jrudley https://github.com/jrudley !

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/Azure-Samples/jmeter-aci-terraform/issues/58#issuecomment-793189040, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAOYIS65FPGCUCQBQFZAWE3TCVRCZANCNFSM4Y2DOAFQ .