search

Snooz82 / robotframework-datadriver

Library to provide Data-Driven testing with CSV tables to Robot Framework
Apache License 2.0
131 stars 37 forks source link

Rerunfailed test cases in parallel with pabot #61

Open ddufrasn opened 3 years ago

ddufrasn commented 3 years ago

Hello,

With the latest update I'm having issue to rerun failed test cases in parallel with pabot.

I have an Excel sheet that contains 450 test cases and I'm using Datadriver in my robot file with: Library DataDriver file=MyFile.xlsx sheet_name=Test cases optimize_pabot=Atomic

Here is the way I am launching it:

First run: pabot.exe --testlevelsplit --pabotlib --pabotlibhost %PABOT_HOST% --pabotlibport %PABOT_PORT% --processes 40 -d %RESULTDIR% -o orig.xml -l orig_log.html -r orig_report.html -e %RF_EX_TAGS% %TESTS_FILE_PATH%

Everything runs in parallel but the outcome I have several failures (50/450 test cases) so I want to retry those 50 failed one but in parallel as well therefore I'm using:

pabot.exe --testlevelsplit --pabotlib --pabotlibhost %PABOT_HOST% --pabotlibport %PABOT_PORT% --processes 40 -d %RESULTDIR%/ -o rerun.xml -l rerun_log.html -r rerun_report.html -e %RF_EX_TAGS% --prerunmodifier DataDriver.rerunfailed;%RESULTDIR%/orig.xml %TESTS_FILE_PATH%

The outcome of the rerun is that it's running one by one the failed test cases and not in parallel :(

Am I doing it wrong for the rerun?

Thanks

ftdgeri commented 1 year ago

I met the same problem. I use the following command, pabot --verbose --pabotlib --testlevelsplit --processes 10 --prerunmodifier DataDriver.rerunfailed:output.xml --output rerun.xml --variable TEST_ENV:${TEST_ENV} TestSuites/${JOB_BASE_NAME}.robot the test is triggered but it only run the failure test one by one rather than in parallel. not sure what's wrong.