search

kobenguyent / codeceptjs-rphelper

4 stars 23 forks source link

Does not work correctly with tryTo plugin #36

Open reveritas opened 1 month ago

reveritas commented 1 month ago

Tests that use the tryTo functionality are not sent to ReportPortal correctly. If the step inside tryTo fails, this plugin seems to consider that step as actually failed and does not continue sending the rest of the steps. The test in ReportPortal shows as "passed" even though the last step is the failed tryTo step, and its status is "IN_PROGRESS" because the plugin stopped sending updates.

The only other reference to this issue I found is https://github.com/codeceptjs/CodeceptJS/issues/3632, where your response was to use this library instead of reportportal/agent-js-codecept. So I'm out of direct options since it is now also happening with this library.

If you could confirm that this issue exists and you are unable to take care of it at this moment in time, we can look into providing a fix. The only other option is replacing all our usages of tryTo with an equivalent, Codecept-internal check.

We are using the same versions as the ones in this library (CodeceptJS 3.5.12).

kobenguyent commented 1 month ago

Thanks for your report, @reveritas! Sure thing, your fix would be really appreciated.