dutchiexl / BehatHtmlFormatterPlugin

This is a behat plugin to generate HTML reports
MIT License
112 stars 116 forks source link

Your Use Cases are important! #113

Open PurHur opened 5 years ago

PurHur commented 5 years ago

Hey,

lets discuss some usecases of this plugin/report. We should collect some data about our usecases and what we need in the very basic base template. (This can be switched soon)

I have a few questions but dont bother so explain what and why something is important for you in the report.

How many tests do you have in one report? How much are failing if something happen? How do you organize your tests? folder structure? tags? Do you store each report? How big should it be? Parallel stuff? Do you send them via email? Do you use this as a dashboard?

Would be great to see some input here to move forward.

fr33ek commented 5 years ago

Hello!

I have about 400 scenarios. Sometimes it can fail about 100. I just have folder tests/behat. I save reports as an artifact for some time only if pipeline failed. I use gitlab-ci for this. I run two test jobs in a parallel, they have different reports. I don't send them vie email for now, and don't use on a dashboard. I still have some problems showing screenshots in my report - that is needed feature for me.