search

microsoft / azure-pipelines-tasks

Tasks for Azure Pipelines
https://aka.ms/tfbuild
MIT License
3.5k stars 2.61k forks source link

[BUG]: automated Test with DynamicData setup #20467

Open lucavoit opened 1 month ago

lucavoit commented 1 month ago

Task name

VsTestV3

Task version

3.*

Environment type (Please select at least one enviroment where you face this issue)

Azure DevOps Server type

dev.azure.com (formerly visualstudio.com)

Azure DevOps Server Version (if applicable)

No response

Operation system

Windows 11

Question

I have an extensive Test Plan setup up with linked automations through a MSTest project. One Testcase is a [DataTestMethod] with [DynamicData] coming from a json within the repo. 

When using VSTEST Task with the setting 'Test Assemblies' the dynamic test method works just fine, but the linked testplan doesnt get the results. When using 'Test Plan' the linked testplan does get the results but the dynamic method only runs once with the first "row" of the dynamic data.

How can I set this up, so the dynamic method iterates through all data and reports the results to the linked test case?
lucavoit commented 2 days ago

Hey @v-schhabra, could any member of your team please have a look through this problem?

v-schhabra commented 2 days ago

Hi @lucavoit This task is not owned by our team. I will ask the owners of this task to take a look.

v-schhabra commented 2 days ago

@virekumar Could you or someone from your team please check the above issue? I hope you are the owner of this task.

virekumar commented 1 day ago

ACK, we will have a look at this in upcoming sprint.