Open vamshikrishnapallerla opened 7 months ago
@grasshopper7 @arun-k @grass-hopper-moc can you check and update on this issue?
Do you have the same behavior when you execute this in your local environment, without grid setup?
@grasshopper7 When running in local environment(sequential execution) reports are generated as expected(accurate).
When running on grid, if none of my test cases has example sets then also I am getting the correct reports.
Issue is with running scripts on grid with 2+ nodes and having test cases with multiple example sets. cc: @arun-k @grass-hopper-moc
Can you try this in parallel mode in local environment?
I will try this and post the updates here either today or tomorrow.
Hi @grasshopper7 I have tested the above and below are the findings.
When I am using dependency version 1.14.0 we are having the issue in the local environment also.
When I downgraded the version from 1.14.0 to 1.9.2 the reports are coming as expected, is there any major change in relation to parallel execution between these two versions?
We are using cucumber framework for my project and running my test cases on selenium grid, but when I look at the report i.e pdf and spart extent reports, test scenarios from one feature file is getting mapped to another feature files when there are multiple example data sets for test cases.
Feature 1: @Login Feature: Bing feature file
@TC_01 @test Scenario Outline: Test on Bing Given User navigate to Bing.com When Enter search keyword on Bing
Feature 2: @Login Feature: Google Feature file
@TC_02 @test Scenario Outline: Test on Google Given User navigate to Google.com When Enter search keyword on Google
I am running these test cases in parallel with below setting on selenium grid having 2 nodes available. @Override @DataProvider (parallel = true) public Object[][] scenarios(){ return super.scenarios(); }
Below is image of our selenium grid:
Below is the pdf report generated TestExecutionReport.pdf
Below is the screenshot if spart extent report issue Not able to attach html report here. Ideally it should be present under google feature file
in the summary or failed scenarios section of pdf you can see under bing feature file one of google test is mapped.
is it a known issue? this is a critical issue we had, can you help us on this.
dependencies used in the project are: