search

ovh / venom

🐍 Manage and run your integration tests with efficiency - Venom run executors (script, HTTP Request, web, imap, etc... ) and assertions
Apache License 2.0
1.06k stars 144 forks source link

(suggestion) Customize test result filename #757

Closed bcecchinato closed 3 months ago

bcecchinato commented 11 months ago

Hello !

Currently it is possible to cutomize the test report directory, but the filename is always test_results_TEST-NAME.type. Is it possible to add an option to set a templatized name instead ? This would allow us to add the timestamp in the filename, and some of the parameters, which will prevent our tests to override the repport each time it is launched.

Thanks !

kpassoubady commented 10 months ago

Yes, this is greatly help. When we run the test cases in parallel, unless you create an output directory for each test suite, the test results are overwritten due to the same test_results.html Here is a sample directory structure. I

image
bcecchinato commented 3 months ago

Why closing this issue as it's not treated or fixed ?

kpassoubady commented 3 months ago

Yes, adding a facility to customize the result file names is a good feature.

yesnault commented 3 months ago

if outputDir is set, It's expected to have the same filename each time venom is is triggered. If you want to save output files, you have to set another outputDir (or mv the outputDir) before running venom another time.

kpassoubady commented 3 months ago

But if you try to run them in parallel, it is a good feature to have a fileNameWithDDMMYY_HH24MMSS_SSS.ext

yesnault commented 3 months ago

run in parallel -> you have to use different output-dir