search

reportportal / agent-Python-RobotFramework

Robot Framework integration for Report Portal
Apache License 2.0
59 stars 32 forks source link

Overall stats don't appear after launch completes [v5] #54

Closed iamtech123 closed 4 years ago

iamtech123 commented 4 years ago

Describe the bug No summary stats (total, passed, failed etc.) are appearing for my launch

To Reproduce I am facing this issue while using Robot Framework integration with Report Portal5 Issue occurs when Test teardown / Suite Teardown is used. Tests are updated when Test teardown / Suite Teardown is removed.

Screenshots ReportPortal_TestResults_NotUpdated

evjlobanova commented 4 years ago

@iivanou could you please look at this issue? May a problem be related to the python agents?

iivanou commented 4 years ago

@iamtech123 are you using robotframework-reportportal for reporting your tests? If yes, what is the version of the agent?

iamtech123 commented 4 years ago

Yes i am using robotframework-reportportal. Unfortunately python got uninstalled due to stability issue in my machine but i have used the first version of robotframework-reportportal released for Report portal5. Please refer here https://github.com/reportportal/client-Python/issues/66#issuecomment-597497455

iivanou commented 4 years ago

Then, how do you report your results?

iamtech123 commented 4 years ago

The python got uninstalled last Friday. Till that time i was using it and faced the above mentioned error.

iivanou commented 4 years ago

The mentioned issue has already been fixed. As far as you are not using the agent for reporting, I do not understand your problem. How do you report your results if you are not using the agent?

iamtech123 commented 4 years ago

@iivanou Thanks a lot for the updated. As i mentioned here https://github.com/reportportal/reportportal/issues/908#issuecomment-609086333, I was using python agent till last Friday. I am setting up the environment now and will update you the results.

iamtech123 commented 4 years ago

@iivanou i am still facing the issue. Please find the pip list below image

In Report portal image

command used robot --listener robotframework_reportportal.listener --variable RP_UUID:"xxx" --variable RP_ENDPOINT:"http://xx:8080" --variable RP_LAUNCH:"Prj1_smoke" --variable RP_PROJECT:"prj1" C:\Git\Sample1.robot

iamtech123 commented 4 years ago

Sample test case (Not working)

Settings Library Collections

Test Cases Case1 LOG Case1 [Teardown] LOG END

Above test case reports correctly while i remove the [Teatdown] line

iivanou commented 4 years ago

@iamtech123 Can you test changes from #55?

iamtech123 commented 4 years ago

When can we expect the merge version to be tested. What would be the merged version number.

iivanou commented 4 years ago

@iamtech123 You can test changes without merge. Firstly, the changes must be tested, and only then - released. Not vice versa. I tested PR on my side but wanna get the confirmation from you as well.

iamtech123 commented 4 years ago

@iivanou, the fix looks stable. I have tried some combinations with Test Setup, Teardown, Suite Setup and Teardown.

bharatslalchandani commented 4 years ago

@iivanou: I am also having this issue where if there is test tear down or test setup then overall results do not show up. May I know release plans for the latest version of the library that has these changes merged (cause library on PyPI still shows 5.0.1 version where this issue still exists)?

iivanou commented 4 years ago

@bharatslalchandani 5.0.2 has been released.

bharatslalchandani commented 4 years ago

@iivanou: 5.0.2 worked like a charm, thanks a lot.