search

reportportal / agent-Python-RobotFramework

Robot Framework integration for Report Portal
Apache License 2.0
59 stars 33 forks source link

run listeners from RF report file #74

Closed egibbm closed 4 years ago

egibbm commented 4 years ago

We have built a tool by extending your agent to allow posting results to reportportal using RF output.xml.

From the command's doc:

This tool replays a Robot Framework test session using the output XML file
with ReportPortal's listener agent injected without actually doing the test.
This will allow all the test results to be sent to ReportPortal, after the
test is run. By doing this, we will not disturb the timing when the test is
run. It also has the benefit of using the test result generated after running
multiple parallel robot testing (eg. by using pabot).

This will help solve similar issue as #65.

Let me know if you're interested in merging this to yours. I'll be glad to help.

egibbm commented 4 years ago

Apart from the other comments. What are the major benefits of this implementation comparing to the built-in import functionality of the ReportPortal UI?

the import interface only capable of handling xunit format, which is inadequate / do not provide as complete information as the one provided by listeners. It does not record keywords, so we miss the ability to trace issues/flakiness from the reportportal UI.

egibbm commented 4 years ago

btw do we still need to support python2? The check is false positive. image

iivanou commented 4 years ago

btw do we still need to support python2? The check is false positive. image

Unfortunately, there are loads of agent consumers who are still running Python 2. If you wanna add type hints into the project, you can create *.pyi files.