search

awslabs / aws-device-farm-jenkins-plugin

Jenkins plugin for AWS Device Farm.
Apache License 2.0
89 stars 66 forks source link

"Ignore Device Farm errors in build result." option is not working #43

Open facos86 opened 8 years ago

facos86 commented 8 years ago

Hi, I activated "Ignore Device Farm errors in build result." to ignore potential failed tests in DeviceFarm. However, the option is not working, at the end of a failed test run, I got in Jenkins : [AWSDeviceFarm] Test run is complete. Build step 'Run Tests on AWS Device Farm' changed build result to FAILURE

facos86 commented 8 years ago

Anyone ?

anurag1408 commented 7 years ago

Hi

Thanks for reporting this. Can you share the URL of the run from Device farm console for which you experienced this issue. This would help us in investigating furher

MattHamersky commented 7 years ago

Hi, we are actually experiencing this same issue. I noticed that the original poster never responded so figured I would step in.

Here's the link to the run on the device farm console: https://us-west-2.console.aws.amazon.com/devicefarm/home?#/projects/3bf5223e-bc18-452f-b17c-b04cba4c9d35/runs/fa43ea3d-3880-4f36-9d1d-3d37297761a3

Just to reiterate, on Jenkins we have the box for "Ignore Device Farm Errors in Build Result" checked, but this build was still marked for failure by the Device Farm.

itomaldonado commented 6 years ago

I am having the same issue 👍

scottasoutherland commented 5 years ago

I'm having the same issue when using this plugin in a pipeline script with ignoreRunError: true , the build fails regardless.

scottasoutherland commented 5 years ago

In fact, for me the build fails even when all of the tests pass

Kertic commented 3 years ago

This issue is still present in the current version of the plugin

EDIT: https://us-west-2.console.aws.amazon.com/devicefarm/home?#/projects/25cf55b9-04bf-4a71-bd1c-7ce792e4d42e/runs/a3088a34-cda2-4a5a-9361-41717c927f34

This is a run that has demonstrated the issue in hand