SpecFlowOSS / SpecFlow

#1 .NET BDD Framework. SpecFlow automates your testing & works with your existing code. Find Bugs before they happen. Behavior Driven Development helps developers, testers, and business representatives to get a better understanding of their collaboration
https://www.specflow.org/
Other
2.22k stars 751 forks source link

Occasional failure with SpecFlow+LivingDoc ADO dashboard generation #2712

Open jrod567 opened 11 months ago

jrod567 commented 11 months ago

SpecFlow Version

0.6.964

Which test runner are you using?

NUnit

Test Runner Version Number

v3+

.NET Implementation

.NET 6.0

Project Format of the SpecFlow project

Sdk-style project format

.feature.cs files are generated using

SpecFlow.Tools.MsBuild.Generation NuGet package

Test Execution Method

TFS/VSTS/Azure DevOps – Task – PLEASE SPECIFY THE NAME OF THE TASK

SpecFlow Section in app.config or content of specflow.json

Task : SpecFlow+LivingDoc

Issue Description

We've been using the SpecFlow+LivingDoc Azure DevOps task to upload our living doc results to the ADO Specflow dashboard successfully for a number of months now. Generally speaking, we really haven't had any issues except one.

Occasionally we've seen the following output in one of our build tasks after uploading in the task. It's happened maybe 2 times in a span of 6 months; all tests are passing and everything else in the pipeline is successful:

image

I'm unsure if this is just a random ADO failure somewhere or something with the task or other. Any ideas?

Steps to Reproduce

task: SpecFlowPlus@0 displayName: 'Generate Living Doc Dashboard' enabled: true condition: succeededOrFailed()
inputs: generatorSource: 'TestAssembly' testAssemblyFilePath: '$(buildOutputFolder)\$(testAssemblyName)'
testExecutionJson: '*\LivingDoc\LivingDoc_.json' workItemPrefix: 'WI:' workItemUrlTemplate: '$(azureDevOpsUrl)/_workitems/edit/{id}' projectName: '$(repositoryName)'

Link to Repro Project

No response