garris / BackstopJS

Catch CSS curve balls.
http://backstopjs.org
MIT License
6.71k stars 602 forks source link

Issue with running the test in Travis #231

Open sjorsjes opened 8 years ago

sjorsjes commented 8 years ago

I'm trying to integrate BackstopJS with my current workflow. I commit some changes and then Travis will check if the build was successful. Sadly I'm not able to get this up and running.

I've run npm run reference to generate the reference files and included those in my repository. On my local machine it works fine, BackstopJS does the checks and without any errors. Somehow it looks like Travis is not able to find the reference files and always gives mismatch errors.

When I generate the reference files while building, instead of using the pre-committed ones, BackstopJS will complete without any errors. But this is not what I want because obviously the test will always be successful since it's matching the same files.

All files can be found here. The tests can be run with npm run

Any idea's what could be the issue?

garris commented 8 years ago

@sjorsjes thank you for posting! I looked at your travis log and it is indeed puzzling what the issue could be. Question, are the compare files getting written to the travis container? i.e. does this file exist See: /home/travis/build/vicompany/ezpz-flexbox-grid/test/backstop_data/bitmaps_test/20160726-113335/failed_diff_0_0_chapternth-of-type1_0_tiny.png?

I have a meeting I need to jump into and then I have a busy day. I suspect the same thing you do -- somehow file references are wonky in the travis environment -- so perhaps it may take a little more trial and error. But don't give up -- it looks like you are really close!

I will try to recreate the issue on my end when I get a chance. In the mean time -- if you do solve it, please post back -- I'm sure this could help others...

Cheers.

-GS