Describe the bug
Steps that are skipped in Robot Framework test execution (IF/ELSE trees) sometimes show as PASSED in Report Portal UI.
Robot test file:
*** Test Cases ***
First
[Documentation] first testcase
Log Use builtin logger
#Second
# [Documentation] second testcase
# Fail utterly
Third
[Documentation] third testcase
${var_x}= Set Variable ${FALSE}
IF ${TRUE}
Log In true IF
IF ${var_x}
Log IN IF
ELSE
Testing
END
END
*** Keywords ***
Testing
[Arguments] ${no_test}=${FALSE} ${test}=${TRUE}
IF ${no_test}
${status}= Run Keyword And Return Status Fail utterfly
Log error
END
IF ${no_test}
${status}= Run Keyword And Return Status Fail utterfly
Log error
END
IF ${no_test}
${status}= Run Keyword And Return Status Fail utterfly
Log error
END
IF ${no_test}
${status}= Run Keyword And Return Status Fail utterfly
Log error
END
IF ${no_test}
${status}= Run Keyword And Return Status Fail utterfly
Log error
END
IF ${no_test}
${status}= Run Keyword And Return Status Fail utterfly
Log error
END
IF ${test}
${status}= Run Keyword And Return Status Log test
Log testing
END
Steps to Reproduce
Steps to reproduce the behavior:
Describe the bug Steps that are skipped in Robot Framework test execution (IF/ELSE trees) sometimes show as PASSED in Report Portal UI.
Robot test file:
Steps to Reproduce Steps to reproduce the behavior:
Expected behavior Skipped IF/ELSE blocks are shown as SKIPPED, not PASSED.
Actual behavior Skipped IF/ELSE block are shown as PASSED, not SKIPPED.![image](https://user-images.githubusercontent.com/92289862/235590898-11da175d-7aea-4a16-8bb6-f54dc579c21f.png)
Package versions
Additional context Might be related to issue https://github.com/reportportal/agent-Python-RobotFramework/issues/145 (or not).