johanneswuerbach / ember-cli-sauce

Cross browser testing for your ember-cli app using SauceLabs
MIT License
40 stars 14 forks source link

Export individual Qunit failure details #54

Closed danevans closed 8 years ago

danevans commented 8 years ago

Log the details of each failed test and send them to SauceLabs along with the other test result info.

Limit to first 15 failures because of a SauceLabs bug.

Fixes #53

johanneswuerbach commented 8 years ago

:bow:, this was on my todo list for a while. Test results are posted to customData, which has a limit of 64KB https://wiki.saucelabs.com/display/DOCS/Test+Configuration+Options#TestConfigurationOptions-CustomData

Maybe we could somehow add results until we reached 60KB or similar?

danevans commented 8 years ago

Good to know about the 64KB limit. I'm happy to update to be more precise with that limit.

I haven't worked with travis before and this failure doesn't make sense to me. Do you know what is going on with it?

johanneswuerbach commented 8 years ago

Looks like travis has issues currently https://www.traviscistatus.com/incidents/lp492hx0z1my, as soon those are resolved some hopefully more helpful error message should be displayed.

danevans commented 8 years ago

The error messages are not very clear as to what's wrong. Could it be something like using the => instead of function syntax?

johanneswuerbach commented 8 years ago

Yes, please use only function and var as we still need to support old IEs here and the file isn't transpiled.

danevans commented 8 years ago

I can squash these commits if everything looks good to you.

johanneswuerbach commented 8 years ago

Looks really good to me 👍 Will merge once squashed :-)

danevans commented 8 years ago

Awesome! thanks for being so responsive.

johanneswuerbach commented 8 years ago

Thanks again for contributing this, I'll test that a bit more manually and then release within the next few days.

johanneswuerbach commented 8 years ago

Released as 1.7.0, thanks again 👏