"Run Keyword And Ignore Error" child keywords status taken into account by Report Portal

[CorentinHache]

Describe the bug

The "Run Keyword and ignore error" child keywords status are taken into account by report portal. While the error status and messages of these keyword should be ignored by Report Portal, the messages appear in the "Unique Error" and in the Investigation page.

Steps to Reproduce

• Write de Robot Framework Code with some "Run Keyword and ignore error" and a failed step at the end
• Execute it and push it to Report Portal

*** Test Cases ***
Test Report Portal Logs
    Run Keyword And Ignore Error    Failed Keyword
    Run Keyword And Ignore Error    Failed Keyword
    Run Keyword And Ignore Error    Failed Keyword
    Fail    msg=The reason why the test is failed

*** Keywords ***
Failed Keyword
    Fail    msg=To be ignored

Expected behavior "Run Keyword and ignore error" child keywords should not be taken into account and not be displayed in the Unique Error and Investigation pages

Actual behavior "Run Keyword and ignore error" child keywords are taken into account and displayed in the Unique Error and Investigation pages

Package versions robotframework_reportportal-5.5.3

[CorentinHache]

The same erroneous behaviour is present for the "Wait Until Keyword Succeeds" keyword :

Describe the bug

In Robot Framework, the "Wait Until Keyword Succeeds" (WUKS) function is used as active delay. This fonction execute several times an action until the action succeeds :

If the action succeeds before a specified duration or a specified number of attempt, the "Wait Until Keyword Succeeds" succeeds. Even if the first attempts of the action have been failed. If the action didn't succeeds after a specified duration or a specified number of attempt, the "Wait Until Keyword Succeeds" fails. Report Portal take into account the error message returned by the failed action inside the WUKS, while it should not.

Steps to Reproduce

Create a Robot Framework script that include a "Wait Until Keyword Succeeds" that is passed after a least one failed attempt. The test should be failed for any reason after the "Wait Until Keyword Succeeds" statement. Push the test result to Report Portal

Expected behavior

Report Portal display the error message that is the cause of the failed test. Actual behavior

Report Portal display the error message that is the cause of the failed test AND the error message of the first attempt of the "Wait Until Keyword Succeeds"

Package versions robotframework_reportportal-5.5.3 ROBOT_FRAMEWORK_VERSION 7.0.0

[HardNorth]

@CorentinHache This is how it was designed, Unique Error analysis works across all ERROR logs inside a failed test, despite the status of the parent nested steps.

[CorentinHache]

Thank you for your message @HardNorth It is possible to fix the issue by patching the Robot Framework output.xml using "rebot" to remove such temporary "failed" step :

rebot --RemoveKeywords WUKS --RemoveKeywords WHILE --RemoveKeywords FOR -o output-patched.xml output.xml

[HardNorth]

@CorentinHache It's up to user to decide what to do in this case, we can't accept it as general solution, since some users naturally will want to see all logs. But thanks for mentioning this option here, some might search and find this solution suitable.