serenity-bdd / serenity-core

Serenity BDD is a test automation library designed to make writing automated acceptance tests easier, and more fun.
http://serenity-bdd.info
Other
720 stars 519 forks source link

Serenity Report Reason for all failures #3450

Open VeroBalta opened 6 months ago

VeroBalta commented 6 months ago

What's the Problem You're Trying to Solve?

Currently from serenity report we only read number of Passed and Failed test cases, without considering a reasons for other failures. currently using serenity 3.7.1 Serenity report shows status for failed Steps and Test cases. Need to know the reason of all failed why is broken, or skipped.... do we need to add proper error message? Looking to improve more our serenity report e.g.

  1. Test Step: Skipped, Ignored, Pending, Incomplete,Failed

  2. Test cases : Skipped, Ignored, Broken, Compromised, Aborted, Error, Undefined

I find this but is not enough explanation: https://serenity-bdd.github.io/docs/reporting/the_serenity_reports

Proposed Solution

looking to improve our serenity report

Alternative Solutions

No response

Implementation Support

globalworming commented 5 months ago

you can throw specific exceptions, this doc is a bit older but it probably still works like this

https://serenity-bdd.info/docs/articles/semantic-exceptions.html

VeroBalta commented 5 months ago

@globalworming thank you, what I am looking is the reasons of failure of the above mentioned

wakaleo commented 5 months ago

You can write your own custom report or propose a PR to enhance the existing reports by adapting the Freemarker templates in the serenity-resources module. Alternatively, if this is valuable for your work or your organisation, you can always request a commercial support package so we can do it for you.

VeroBalta commented 5 months ago

@wakaleo Thanks for that info, serenity report is beautiful I was just checking if is any documentation out there where is explain the cause of failure.