search

serenity-bdd / serenity-cucumber

Cucumber integration for the Serenity BDD Reporting library
Other
78 stars 74 forks source link

Serenity reports: Is it possible to get the count of scenarios with @Ignored tag without actually running those scenarios? #200

Open shailysingh opened 5 years ago

shailysingh commented 5 years ago

We have added @Ignored tag to certain scenarios and would like to get the count of these ignored scenarios in the Serenity report without actually running them.

If we use the tag "~@Ignored" then the scenarios are not executed as expected, but even the count is not visible in the report.

If we do not use the above tag, then the count is displayed in the report, but the ignored scenarios are also executed which take some time.

Is there a possibility to display the count without running the scenarios? Basically, the scenarios are ignored or skipped with the intent that they should be skipped from execution when the test suite is run.

wakaleo commented 5 years ago

This cannot be done is a general way since Serenity does not control the Cucumber test execution.

shailysingh commented 5 years ago

Thank you for your response, @wakaleo , though I am not sure how to implement it via Cucumber. Do you have an idea?

wakaleo commented 5 years ago

Use Screenplay or make sure your glue code only calls @Steps-annotated libraries

wakaleo commented 5 years ago

If you have assertions in your glue code, these will still fail for an ignored test, but it will be reported as Ignored

shailysingh commented 5 years ago

Thank you, I will try and update here.