search

SpecFlowOSS / SpecFlow

#1 .NET BDD Framework. SpecFlow automates your testing & works with your existing code. Find Bugs before they happen. Behavior Driven Development helps developers, testers, and business representatives to get a better understanding of their collaboration
https://www.specflow.org/
Other
2.22k stars 752 forks source link

Documentation request: Help with Specflow, Nunit, Azure Devops Pipelines slices #2641

Closed infinitejest69 closed 1 year ago

infinitejest69 commented 1 year ago

Product:

What is missing: So i have an issue and not sure where to start. My Setup: c# Test, Nunit with Test adaptor, Azure pipeline running ~ 700 tests over multiple feature files. We use a decent amount of Before and After feature hooks to set up test data. My issue: i am using vsTest@2 to run the tests over multiple agents in azure devops pipelines. The reason for using the vstest and not dotnet test is the rerun failed tests feature that helps elminate some flake from result. It appears tests are being sliced that tests from one feature could be over multiple machines running the before and after feature steps multiple times and this can cause chaos with test data. Specflow limits runs are done by fixture and when run on a single machine that's fine. i would like the slices to run a feature / fixture sliced across n machines.

Should i be looking at a Nunit setting, specflow setting, VStest setting. just wondering if anyone has experience with distributing spec flow tests across multiple agents

infinitejest69 commented 1 year ago

Not Required Think the issue might lie with the pipeline task as it controls the slicing

github-actions[bot] commented 1 year ago

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.