search

ttutisani / Xunit.Gherkin.Quick

BDD in .NET Core - using Xunit and Gherkin (compatible with both .NET Core and .NET)
MIT License
205 stars 29 forks source link

Pickles Doc compatibility for scenario outlines #83

Open videege opened 5 years ago

videege commented 5 years ago

We use Pickles (https://github.com/picklesdoc/pickles) to package up our results and feature files as a nice readable website as part of our CI/CD process. Currently, Pickles is able to match test results to scenarios correctly for everything but scenario outlines - these all end up blank in the Pickles output despite having entries in the test output.

I am generating a XML results file by running dotnet test --test-adapter-path:. --logger:xunit -r /results. Scenario outline results in the file look like this:

    <test name="Feature Name :: Scenario Outline Name :: Example Name :: #1" type="Path.To.Namespace" method="ScenarioOutline" time="0.5140000" result="Pass">
        <output>Given A: PASSED
When B: PASSED
Then C: PASSED

</output>
        <traits>
          <trait name="FeatureTitle" value="Feature Name" />
          <trait name="Description" value="Feature Name :: Scenario Outline Name :: Example Name :: #1" />
          <trait name="Category" value="@tag1" />
          <trait name="Category" value="@tag2" />
          <trait name="Category" value="@tag3" />
        </traits>
      </test>

I'm not sure if the issue is with Xunit.Gherkin.Quick or PicklesDoc not interpreting correctly (it claims to understand 'xunit2' results files, but I'm not sure if this is universal or just SpecFlow-specific xunit results.), so I figured I'd ask.

ttutisani commented 5 years ago

@videege I cannot speak to pickles too much, unfortunately, not yet.

By looking at the commit history, I see that @csurfleet implemented that compatibility. Maybe he could help. @csurfleet any thoughts?

ttutisani commented 4 years ago

@videege did you find the answer to your question, or is it still an issue?

videege commented 4 years ago

This is still an issue for my team, but I haven’t investigated it any further.

On Jan 9, 2020, at 6:25 PM, Tengiz Tutisani notifications@github.com wrote:

 @videege did you find the answer to your question, or is it still an issue?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe.

csurfleet commented 4 years ago

@videege so sorry, I only just spotted this! I'm actually hooking in PicklesDoc to some Scenario Outlines at the moment, so I'll hopefully have got this confirmed and bottomed for you in the next couple of weeks