allure-framework / allure-java

Allure integrations for Java test frameworks
Apache License 2.0
355 stars 225 forks source link

When running the same test in different suites, the test does not merge in report #1132

Open Awesomefreeman opened 1 year ago

Awesomefreeman commented 1 year ago

Describe the bug When running the same test across different suites, test results are not combined in the report.

To Reproduce Steps to reproduce the behavior:

  1. Clone my exaple repo https://github.com/Awesomefreeman/MyAllureProject
  2. Run SuiteOne
  3. Run SuiteTwo
  4. Generate Allure Report

Expected behavior I expect that both runs of the same test will be combined into one in the Retries tab. I'll try to explain why this is needed. Let's imagine that I run 10 tests using the suite and 3 of the tests fails. I have a list of failed tests with a fully qualified name, then I want to retry these tests. I run the command mvn clean -Dtest=ClassName#failed_test,... test I generate a report and expect to see 10 tests in the report, 3 of which are re-run. Now I will see 13 tests

Described in detail in this article https://habr.com/ru/companies/jugru/articles/337386/ image

Screenshots Two same tests in allure report

image

Desktop (please complete the following information):

raialmeida commented 11 months ago

Hello,

How did you display the test run data in the test body? The execution here does not display any data in the test body

Awesomefreeman commented 11 months ago

Hello,

How did you display the test run data in the test body? The execution here does not display any data in the test body

What do you have in mind? My test contains a query on https://google.com for example @Test void test_01() { given() .filter(new AllureRestAssured()) .relaxedHTTPSValidation() .when() .log().all() .get("https://www.google.com") .then() .log().all() .statusCode(200); }