We have noticed an issue with the total elapsed time in the merged output.xml file that is generated after executing multiple test suites. The problem is that this file will display the elapsed time of the first suite as the total elapsed time.
So for example if we execute 5 suites where the first one takes 10 seconds and the rest of them takes 30 seconds each. The merged output.xml file will incorrectly show the elapsed time as 10 seconds. Worth noting however is that the report.html will show the correct elapsed time.
This issue seems to occur when the pabot_results output.xml files are generated in schema version 5.
A workaround is currently available where passing the --legacy-output flag will configure the output.xml files to be generated in schema version 4 instead which results in the merged output.xml file having the correct total elapsed time.
The issue can be reproduced by executing multiple test suites and then inspecting the output.xml to see that the elapsed time reflects only the first suite's time, not the total time of all suites
Hello,
We have noticed an issue with the total elapsed time in the merged output.xml file that is generated after executing multiple test suites. The problem is that this file will display the elapsed time of the first suite as the total elapsed time.
So for example if we execute 5 suites where the first one takes 10 seconds and the rest of them takes 30 seconds each. The merged output.xml file will incorrectly show the elapsed time as 10 seconds. Worth noting however is that the report.html will show the correct elapsed time.
This issue seems to occur when the pabot_results output.xml files are generated in schema version 5.
A workaround is currently available where passing the --legacy-output flag will configure the output.xml files to be generated in schema version 4 instead which results in the merged output.xml file having the correct total elapsed time.
The issue can be reproduced by executing multiple test suites and then inspecting the output.xml to see that the elapsed time reflects only the first suite's time, not the total time of all suites
Pabot version: 2.18.0 Robot Framework version: 7.0.1
Report is correct:
Output is wrong:
Output with --legacy-output is correct: