search

serenity-bdd / serenity-core

Serenity BDD is a test automation library designed to make writing automated acceptance tests easier, and more fun.
http://serenity-bdd.info
Other
724 stars 518 forks source link

Scenario outline produces false / messed up report for scenario outline in case of parallel execution. #3519

Open AmarjeetSinghMatharu opened 2 months ago

AmarjeetSinghMatharu commented 2 months ago

What happened?

Please find attached snapshot of index report: image

What did you expect to happen?

The report should be as like other test cases which does not use scenario outlines

Serenity BDD version

4.2.0

JDK version

java version "18.0.2.1" 2022-08-18

Execution environment

cucumber/ Java/ Serenity

How to reproduce the bug.

Write a sample scenario outline with say 5 ~ exmples wth a assertion message in test steps. Enable parallel execution as like giving the following properties: cucumber.execution.parallel.enabled=true cucumber.execution.parallel.config.strategy=fixed cucumber.execution.parallel.config.fixed.parallelism=1 cucumber.execution.parallel.config.fixed.max-pool-size=5 cucumber.plugin=io.cucumber.core.plugin.SerenityReporterParallel

Generate reports. Analyze reports as shown in the attached snapshot. The environment is same as like: https://github.com/serenity-bdd/serenity-core/issues/3518

How can we make it happen?

Add it to the Serenity BDD backlog and wait for a volunteer to pick it up