microsoft / azure-load-testing

MIT License
22 stars 2 forks source link

[BUG] Azure DevOps task not picking up on already existent test #124

Open cathalmchale opened 1 year ago

cathalmchale commented 1 year ago

Describe the bug Azure DevOps task not picking up on already existent test.

To Reproduce Steps to reproduce the behavior:

  1. Create a new test manually in the Azure Portal.
  2. Create an Azure DevOps pipeline with task to create/run the Azure Load Test.
  3. Configure DevOps task with details of the already existent Azure Load Test.
  4. Run pipeline and observe that task does not see the existent test and creates a new test with the exact same name!
  5. Re-run the pipeline and observe that this time it does find the existent test. i.e. it finds it if the CI/CD pipeline was used to create the test in the first place, but not if the test was created manually through the Azure Portal.

Expected behavior Should be no difference in finding an already existing test, of the same name, regardless of whether that test is initially created via the CI/CD pipeline task, or created manually through the Azure Portal.

Screenshots image

AB#1687197

Nagarjuna-Vipparthi commented 1 year ago

@cathalmchale Can you please share the test run IDs for us to debug the issue? Thanks

cathalmchale commented 1 year ago

Then I manually added back in ENV and Secrets to get Pass (should be only difference to 442f1a11-fcc3-4c08-bf8d-4cd3cd58fd0b above):

cathalmchale commented 1 year ago

@Nagarjuna-Vipparthi could you find any root cause from the test runs for this issue?