prashant-ramcharan / courgette-jvm

Multiprocess | Parallel Cucumber-JVM | Parallelize your Java Cucumber tests on a feature level or on a scenario level.
MIT License
130 stars 38 forks source link

[Slack]- Test Run Summary card can show more details #310

Closed Vishnuvenu89 closed 2 years ago

Vishnuvenu89 commented 2 years ago

currently test run summary shows below data

We can further customize this by adding below options

Option to show the name of the test suite - Regression/Sanity/Prod Testing - can be set via CourgetteOptions Also option to send Report(Extent/Allure) as link to slack image

mateiQA commented 2 years ago

While we are on this subject, maybe allow a setter method for Session ID so that we can chain multiple runners together based on it? For now, I assume, every runner will create a new session id and if you run 2 runners in the same test run via gradle/maven you will get 2 different test summaries. If we could chain them and create a session id from outside (gradle or mvn build scripts) and pass it to the runner classes we could chain multiple test runners as part of the same 'run'. Concrete example: I run 1 test ng runner class for tests that run headless and 1 test ng runner class for tests that run not headless (for specific tests that don't run under headless mode clipboard data validating etc). I assume each runner class would create it's own TestSummary so if it's possible to merge them somehow (via session id) that would be awesome

prashant-ramcharan commented 2 years ago

@Vishnuvenu89 I can add a slackTestIdentifier Courgette option in a future release.

With regards to sending a link to slack for allure / extent reports - this link would just be pointing to a local path from the machine executing the tests. As these reports are not published anywhere with a public URL, it doesn't make sense to add a link to slack because no one would be able to open it.

prashant-ramcharan commented 2 years ago

@mateiQA In short, this cannot be done.

sessionId is immutable by design and Courgette cannot aggregate and merge results from 2 separate Java processes (i.e. Courgette runners). Results are calculated in memory within each Courgette process so even if we use the same sessionId for multiple Courgette runners, it wouldn't help merge results because one process wouldn't know the results of the other.

mateiQA commented 2 years ago

@mateiQA In short, this cannot be done.

sessionId is immutable by design and Courgette cannot aggregate and merge results from 2 separate Java processes (i.e. Courgette runners). Results are calculated in memory within each Courgette process so even if we use the same sessionId for multiple Courgette runners, it wouldn't help merge results because one process wouldn't know the results of the other.

thanks for the information

prashant-ramcharan commented 2 years ago

You can now use Courgette option slackTestId to specify a custom test id / test suite name etc..

Vishnuvenu89 commented 2 years ago

Great, i will check this today!!!

On Sun, Feb 27, 2022 at 11:51 PM Prashant Ramcharan < @.***> wrote:

You can now use Courgette option slackTestId to specify a custom test id.

— Reply to this email directly, view it on GitHub https://github.com/prashant-ramcharan/courgette-jvm/issues/310#issuecomment-1053637687, or unsubscribe https://github.com/notifications/unsubscribe-auth/AVEPLVL6LNQHWI4UTJVQVCLU5JTTXANCNFSM5NCSNCEQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

You are receiving this because you were mentioned.Message ID: @.***>