search

reportportal / agent-Python-RobotFramework

Robot Framework integration for Report Portal
Apache License 2.0
59 stars 33 forks source link

Teststatus is marked incorrectly, appears as overwritten. #151

Closed FloSch-Nokia closed 1 year ago

FloSch-Nokia commented 2 years ago

Since a few days, some of our results are marked with a wrong status (Failed instead of Passed). For the tests that are marked incorrectly, I can see a action in the History of Actions ( see screenshot )

image

But this action was definitely not triggered by a user. The Robot Framework results are uploaded via post_report. I also post_reported it against a different project, but still experience the same behavior.

Versions:

FloSch-Nokia commented 2 years ago

Now I also can confirm that this happens on a completely fresh 5.7.2

Also image

All Testcases that are appearing as failed in testlink does have the status PASS in the xml

HardNorth commented 2 years ago

@FloSch-Nokia Unfortunately none can catch the reason of this behavior. It's good that you found item update in history view, at least I can look at it again once again.

FloSch-Nokia commented 2 years ago

Maybe also worth to mention, if I post_report the same results mutliple time, not allways the same testcasses are marked as failed and not allways the same amount...

FloSch-Nokia commented 2 years ago

@HardNorth Can you recommend to trace any specific logfile? Here a snippet of the api log and and snippet of the analyzer log during a report posting.

api_log.txt analyzer_log.txt

HardNorth commented 2 years ago

@FloSch-Nokia What is your version of Robot Framework?

FloSch-Nokia commented 2 years ago

Rf is 5.0.1

HardNorth commented 1 year ago

Looks like it's fixed in 5.4.0.