search

microsoft / azure-load-testing

MIT License
22 stars 3 forks source link

[BUG] #27

Closed jometzg closed 2 years ago

jometzg commented 2 years ago

Describe the bug The Azure DevOps pipeline step that was installed from the marketplace fails to run

To Reproduce Steps to reproduce the behavior:

  1. Create a new YAML pipeline in Azure DevOps
  2. Add the Azure Load Test activity
  3. Attempt to run the pipeline

Expected behavior I expect the the load test to run in some manner.

Screenshots image

The following is the debug trace from the pipeline

[debug]Evaluating condition for step: 'AzureLoadTest'

[debug]Evaluating: SucceededNode()

[debug]Evaluating SucceededNode:

[debug]=> True

[debug]Result: True

Starting: AzureLoadTest

Task : Azure Load Testing Description : Automate performance regression testing with Azure Load Testing Version : 1.1.87 Author : Microsoft Corporation Help : https://docs.microsoft.com/azure/load-testing/tutorial-cicd-azure-pipelines#azure-load-testing-task

[debug]Using node path: C:\agents\2.195.2\externals\node10\bin\node.exe

[debug]agent.TempDirectory=D:\a_temp

[debug]loading inputs and endpoints

[debug]loading ENDPOINT_AUTH_0db1e250-96d4-4cd1-9c2e-658befae7a8d

[debug]loading ENDPOINT_AUTH_PARAMETER_0db1e250-96d4-4cd1-9c2e-658befae7a8d_AUTHENTICATIONTYPE

[debug]loading ENDPOINT_AUTH_PARAMETER_0db1e250-96d4-4cd1-9c2e-658befae7a8d_SERVICEPRINCIPALID

[debug]loading ENDPOINT_AUTH_PARAMETER_0db1e250-96d4-4cd1-9c2e-658befae7a8d_SERVICEPRINCIPALKEY

[debug]loading ENDPOINT_AUTH_PARAMETER_0db1e250-96d4-4cd1-9c2e-658befae7a8d_TENANTID

[debug]loading ENDPOINT_AUTH_PARAMETER_SYSTEMVSSCONNECTION_ACCESSTOKEN

[debug]loading ENDPOINT_AUTH_SCHEME_0db1e250-96d4-4cd1-9c2e-658befae7a8d

[debug]loading ENDPOINT_AUTH_SCHEME_SYSTEMVSSCONNECTION

[debug]loading ENDPOINT_AUTH_SYSTEMVSSCONNECTION

[debug]loading INPUT_CONNECTEDSERVICENAMEARM

[debug]loading INPUT_LOADTESTCONFIGFILE

[debug]loading INPUT_LOADTESTRESOURCE

[debug]loading INPUT_RESOURCEGROUP

[debug]loading SECRET_SYSTEM_ACCESSTOKEN

[debug]loaded 14

[debug]Agent.ProxyUrl=undefined

[debug]Agent.CAInfo=undefined

[debug]Agent.ClientCert=undefined

[debug]Agent.SkipCertValidation=undefined

[debug]connectedServiceNameARM=0db1e250-96d4-4cd1-9c2e-658befae7a8d

[debug]0db1e250-96d4-4cd1-9c2e-658befae7a8d auth param serviceprincipalid = ***

[debug]0db1e250-96d4-4cd1-9c2e-658befae7a8d auth param serviceprincipalkey = ***

[debug]0db1e250-96d4-4cd1-9c2e-658befae7a8d data SubscriptionID = 2e500704-1ab3-49c6-bbbb-8b2bec98ffdc

[debug]0db1e250-96d4-4cd1-9c2e-658befae7a8d auth param tenantid = ***

[debug]loadTestConfigFile=D:\a\1\s\SampleApp.yaml

[debug]secrets=undefined

[debug]env=undefined

[debug]resourceGroup=loadtest-rg

[debug]loadTestResource=loadtestingpreview

[debug]task result: Failed

[debug]Processed: ##vso[task.complete result=Failed;]

Finishing: AzureLoadTest

Desktop (please complete the following information):

Smartphone (please complete the following information):

Additional context Very little to go on, it seems the step or marketplace action just does not run. It's equivalent in GitHub actions works (if that's any help). Used debug settings, but little to go on in terms of being able to troubleshoot this.

AB#1458947

ninallam commented 2 years ago

@jometzg could you please confirm if you have assigned "Load Test Contributor" permissions to the service principal? Here are the steps that you could follow

Kokenberg commented 2 years ago

We are seeing the exact same thing:

Author       : Microsoft Corporation
Help         : https://docs.microsoft.com/azure/load-testing/tutorial-cicd-azure-pipelines#azure-load-testing-task
==============================================================================
##[debug]Using node path: /agent/externals/node10/bin/node
##[debug]agent.TempDirectory=/agent/_work/_temp
##[debug]loading inputs and endpoints
##[debug]loading INPUT_CONNECTEDSERVICENAMEARM
##[debug]loading INPUT_LOADTESTCONFIGFILE
##[debug]loading INPUT_RESOURCEGROUP
##[debug]loading INPUT_LOADTESTRESOURCE
##[debug]loading ENDPOINT_AUTH_<serviceprincipal_id>
##[debug]loading ENDPOINT_AUTH_SCHEME_<serviceprincipal_id>
##[debug]loading ENDPOINT_AUTH_PARAMETER_<serviceprincipal_id>_TENANTID
##[debug]loading ENDPOINT_AUTH_PARAMETER_<serviceprincipal_id>a_AUTHENTICATIONTYPE
##[debug]loading ENDPOINT_AUTH_PARAMETER_<serviceprincipal_id>_SERVICEPRINCIPALID
##[debug]loading ENDPOINT_AUTH_PARAMETER_<serviceprincipal_id>_SERVICEPRINCIPALKEY
##[debug]loading ENDPOINT_AUTH_SYSTEMVSSCONNECTION
##[debug]loading ENDPOINT_AUTH_SCHEME_SYSTEMVSSCONNECTION
##[debug]loading ENDPOINT_AUTH_PARAMETER_SYSTEMVSSCONNECTION_ACCESSTOKEN
##[debug]loading SECRET_SYSTEM_ACCESSTOKEN
##[debug]loaded 14
##[debug]Agent.ProxyUrl=undefined
##[debug]Agent.CAInfo=undefined
##[debug]Agent.ClientCert=undefined
##[debug]Agent.SkipCertValidation=undefined
##[debug]connectedServiceNameARM=<serviceprincipal_id>
##[debug]<serviceprincipal_id> auth param serviceprincipalid = ***
##[debug]<serviceprincipal_id> auth param serviceprincipalkey = ***
##[debug]<serviceprincipal_id> data SubscriptionID = <subscription_id>
##[debug]<serviceprincipal_id> auth param tenantid = ***
##[debug]loadTestConfigFile=/agent/_work/1/s/azure/loadtest/test.yaml
##[debug]secrets=undefined
##[debug]env=undefined
##[debug]resourceGroup=<rg>
##[debug]loadTestResource=<resource>
##[debug]task result: Failed
##[debug]Processed: ##vso[task.complete result=Failed;]
Finishing: JMeter/AzureLoadTest

And yes, we have assigned the 'Load Test Contributor' permission to our Service Principal. It would at least be nice to see WHY the task has failed...

ninallam commented 2 years ago

@jometzg @Kokenberg we have added better error messaging. If you are still facing an issue can you please run the task again to see any specific error messages?

ninallam commented 2 years ago

@jometzg @Kokenberg any update on this?

ninallam commented 2 years ago

@jometzg @Kokenberg Closing this issue, since we haven't heard from you.