search

SpecFlowOSS / SpecFlow

#1 .NET BDD Framework. SpecFlow automates your testing & works with your existing code. Find Bugs before they happen. Behavior Driven Development helps developers, testers, and business representatives to get a better understanding of their collaboration
https://www.specflow.org/
Other
2.22k stars 751 forks source link

LivingDoc generated report does not "Show Test Output" #2707

Closed ClearConnect closed 1 year ago

ClearConnect commented 1 year ago

SpecFlow Version

3.9.74

Which test runner are you using?

NUnit

Test Runner Version Number

3.13.3

.NET Implementation

equal or greater .NET Framework 4.6.1

Project Format of the SpecFlow project

Classic project format using packages.config

.feature.cs files are generated using

SpecFlow.Tools.MsBuild.Generation NuGet package

Test Execution Method

Visual Studio Test Explorer

SpecFlow Section in app.config or content of specflow.json

{ "$schema": "https://specflow.org/specflow-config.json", "language": { "feature": "en-US" }, "stepAssemblies": [ { "assembly": "Test.UI.Pages" }, { "assembly": "Framework.UI.Core" }, { "assembly": "SpecFlow.Assist.Dynamic" } ], "runtime": { "stopAtFirstError": false }, "livingDocGenerator": { "enabled": true, "filePath": "TestExecution.json" }

}

Issue Description

Please Help! using 3.9.57 ver of SpecFlow.Plus.LivingDocPlugin . HTML report files produced using LivingDoc CLI report generator ver 3.9.57+gcf5c4dd9b9 does not cotaint any test output. Clicking "Show test output" does not show any test/image links. The json file generated by the livingDoc plugin appears to have test text/messages and links to screenshot -see the last step in the below: { "Nodes": [

], "ExecutionTime": "2023-05-10T15:57:30.3778011Z", "GenerationTime": "0001-01-01T00:00:00", "PluginUserSpecFlowId": "f4bf3948-ccc9-4c02-a3d1-f29918f7878a", "CLIUserSpecFlowId": null, "ExecutionResults": [ { "ContextType": "Scenario", "FeatureFolderPath": "OrderAhead/ProductConfigurators/Features", "FeatureTitle": "ActionsOnItemsOnReviewYourOrderPage1", "ScenarioTitle": "Navigate Back to Update Decorated Cake on RYO Page", "ScenarioArguments": [], "Status": "TestError", "StepResults": [ { "Duration": "00:00:00.0612208", "Status": "OK", "Error": null, "Outputs": null }, { "Duration": "00:00:00.0204137", "Status": "OK", "Error": null, "Outputs": null }, { "Duration": "00:00:00.2087943", "Status": "OK", "Error": null, "Outputs": null }, { "Duration": "00:00:00.9419915", "Status": "OK", "Error": null, "Outputs": null }, { "Duration": "00:00:30.3349921", "Status": "OK", "Error": null, "Outputs": null }, { "Duration": "00:00:16.7118536", "Status": "OK", "Error": null, "Outputs": null }, { "Duration": "00:00:00.0083560", "Status": "OK", "Error": null, "Outputs": null }, { "Duration": "00:00:05.2401915", "Status": "OK", "Error": null, "Outputs": null }, { "Duration": "00:00:27.3839268", "Status": "OK", "Error": null, "Outputs": null }, { "Duration": "00:00:03.4345633", "Status": "OK", "Error": null, "Outputs": null }, { "Duration": "00:00:07.6399276", "Status": "OK", "Error": null, "Outputs": null }, { "Duration": "00:00:00.0788571", "Status": "OK", "Error": null, "Outputs": null }, { "Duration": "00:00:00.0082640", "Status": "OK", "Error": null, "Outputs": null }, { "Duration": "00:00:06.5596061", "Status": "TestError", "Error": " 2 Configurator option(s) Do NOT match Customized Option on RYO page:\nOption 'Cake size' not found on RYO Page\nOption 'Ice Cream Option' not found on RYO Page\n\n\tRYO Options found:\nCakeSize:Custom Decorated Cake, 8\" Round\nCake Flavor:Vanilla-Chocolate Combo\nIcing Flavor:Vanilla Whipped\nIcing Color:Vanilla Whipped Topping\nIceCreamOption:Yes $4.00\nIce Cream Flavor:Neapolitan\nTrim:C Style\nTrim Color:Pink\nBorder Style:No Border\nDecoration Type:Mums\nDecoration Style:Right Side\nDecoration Color:Orange\nCake Message Option:Black\nCake Message Text:lmnszbmrkbssbdujtcfy\r\n Expected: True\r\n But was: False\r\n", "Outputs": [ { "OutputLocation": "Step", "Type": "Text", "Message": "TEXT", "FilePath": null } ] } ], "Outputs": [ { "OutputLocation": "AfterScenario", "Type": "Attachment", "Message": null, "FilePath": "C:\Projects\Screenshots\\TestFailure_Navigate_Back_to_Update_Decorated_Cake_on_RYO_Page_ChromeDriver_2023_05_10_11_57_26_5726.png" }, { "OutputLocation": "AfterScenario", "Type": "Text", "Message": " 2 Configurator option(s) Do NOT match Customized Option on RYO page:\nOption 'Cake size' not found on RYO Page\nOption 'Ice Cream Option' not found on RYO Page\n\n\tRYO Options found:\nCakeSize:Custom Decorated Cake, 8\" Round\nCake Flavor:Vanilla-Chocolate Combo\nIcing Flavor:Vanilla Whipped\nIcing Color:Vanilla Whipped Topping\nIceCreamOption:Yes $4.00\nIce Cream Flavor:Neapolitan\nTrim:C Style\nTrim Color:Pink\nBorder Style:No Border\nDecoration Type:Mums\nDecoration Style:Right Side\nDecoration Color:Orange\nCake Message Option:Black\nCake Message Text:lmnszbmrkbssbdujtcfy\r\n Expected: True\r\n But was: False\r\n", "FilePath": null } ] } ], "StepReports": null } image

Steps to Reproduce

PS c:> livingdoc test-assembly Test.UI.Projects.Publix.dll -t TestExecution.json --output RunResults.html --output-type HTML Here is the content of TestExecution.json: { "Nodes": [

], "ExecutionTime": "2023-05-10T16:17:49.6627938Z", "GenerationTime": "0001-01-01T00:00:00", "PluginUserSpecFlowId": "f4bf3948-ccc9-4c02-a3d1-f29918f7878a", "CLIUserSpecFlowId": null, "ExecutionResults": [ { "ContextType": "Scenario", "FeatureFolderPath": "OrderAhead/ProductConfigurators/Features", "FeatureTitle": "ActionsOnItemsOnReviewYourOrderPage1", "ScenarioTitle": "Navigate Back to Update Decorated Cake on RYO Page", "ScenarioArguments": [], "Status": "TestError", "StepResults": [ { "Duration": "00:00:00.0688294", "Status": "OK", "Error": null, "Outputs": null }, { "Duration": "00:00:00.0187554", "Status": "OK", "Error": null, "Outputs": null }, { "Duration": "00:00:00.1475111", "Status": "OK", "Error": null, "Outputs": null }, { "Duration": "00:00:00.5669399", "Status": "OK", "Error": null, "Outputs": null }, { "Duration": "00:00:28.1498525", "Status": "OK", "Error": null, "Outputs": null }, { "Duration": "00:00:05.5069479", "Status": "OK", "Error": null, "Outputs": null }, { "Duration": "00:00:00.0298938", "Status": "OK", "Error": null, "Outputs": null }, { "Duration": "00:00:03.6298484", "Status": "OK", "Error": null, "Outputs": null }, { "Duration": "00:00:21.3559483", "Status": "OK", "Error": null, "Outputs": null }, { "Duration": "00:00:02.6108215", "Status": "OK", "Error": null, "Outputs": null }, { "Duration": "00:00:07.6393095", "Status": "OK", "Error": null, "Outputs": null }, { "Duration": "00:00:00.0670576", "Status": "OK", "Error": null, "Outputs": null }, { "Duration": "00:00:00.0068162", "Status": "OK", "Error": null, "Outputs": null }, { "Duration": "00:00:06.3482233", "Status": "TestError", "Error": " 2 Configurator option(s) Do NOT match Customized Option on RYO page:\nOption 'Cake size' not found on RYO Page\nOption 'Ice Cream Option' not found on RYO Page\n\n\tRYO Options found:\nCakeSize:Custom Decorated Cake, 8\" Round\nCake Flavor:Vanilla\nIcing Flavor:Vanilla Whipped\nIcing Color:Vanilla Whipped Topping\nIceCreamOption:Yes $4.00\nIce Cream Flavor:Vanilla\nTrim:C Style\nTrim Color:Purple\nBorder Style:No Border\nDecoration Type:No Decoration\nCake Message Option:Black\nCake Message Text:vcnvxbwmfnnzdmshchmw\r\n Expected: True\r\n But was: False\r\n", "Outputs": [ { "OutputLocation": "Step", "Type": "Text", "Message": "TEXT", "FilePath": null } ] } ], "Outputs": [ { "OutputLocation": "AfterScenario", "Type": "Attachment", "Message": null, "FilePath": "C:\Projects\Screenshots\\TestFailure_Navigate_Back_to_Update_Decorated_Cake_on_RYO_Page_ChromeDriver_2023_05_10_12_17_46_1746.png" }, { "OutputLocation": "AfterScenario", "Type": "Text", "Message": " 2 Configurator option(s) Do NOT match Customized Option on RYO page:\nOption 'Cake size' not found on RYO Page\nOption 'Ice Cream Option' not found on RYO Page\n\n\tRYO Options found:\nCakeSize:Custom Decorated Cake, 8\" Round\nCake Flavor:Vanilla\nIcing Flavor:Vanilla Whipped\nIcing Color:Vanilla Whipped Topping\nIceCreamOption:Yes $4.00\nIce Cream Flavor:Vanilla\nTrim:C Style\nTrim Color:Purple\nBorder Style:No Border\nDecoration Type:No Decoration\nCake Message Option:Black\nCake Message Text:vcnvxbwmfnnzdmshchmw\r\n Expected: True\r\n But was: False\r\n", "FilePath": null } ] } ], "StepReports": null }

Link to Repro Project

No response

ClearConnect commented 1 year ago

Looks like the problem was specific to the solution code

github-actions[bot] commented 1 year ago

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.