search

garris / BackstopJS

Catch CSS curve balls.
http://backstopjs.org
MIT License
6.79k stars 606 forks source link

BackstopJS 3 — Targeting elements #500

Closed boriskaiser closed 7 years ago

boriskaiser commented 7 years ago

I try to capture the footer on www.apple.com with the new version of BackstopJS (3.0.14), see https://github.com/boriskaiser/backstopjs3-playground.

But the screenshots show the header of the page: test_apple_homepage_0_footer_0_phone

Other reference images: https://github.com/boriskaiser/backstopjs3-playground/tree/master/backstop_data/bitmaps_reference

My BackstopJS config: https://github.com/boriskaiser/backstopjs3-playground/blob/master/backstop.json

@garris Have I forgotten something in the config?

garris commented 7 years ago

Can you try downloading this test repo https://github.com/garris/backstop-feature-tests and backstop test in there.

The tests are not up to date so you might get a lot of individual false positives-- but this tests most all BackstopJS features. Selectors should work.

boriskaiser commented 7 years ago

@garris I get this error:

screen shot 2017-08-21 at 18 55 54

Here is the whole output:

BackstopJS v3.0.14
Loading config:  /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop.json

COMMAND | Executing core for `test`
createBitmaps | Selcted 16 of 16 scenarios.
Starting Chromy: port:9222 --window-size=320,480,--ignore-certificate-errors
Starting Chromy: port:9223 --window-size=600,600,--ignore-certificate-errors
Starting Chromy: port:9224 --window-size=1024,768,--ignore-certificate-errors
Starting Chromy: port:9225 --window-size=320,480,--ignore-certificate-errors
Starting Chromy: port:9226 --window-size=600,600,--ignore-certificate-errors
Starting Chromy: port:9227 --window-size=1024,768,--ignore-certificate-errors
Starting Chromy: port:9228 --window-size=320,480,--ignore-certificate-errors
Starting Chromy: port:9229 --window-size=600,600,--ignore-certificate-errors
Starting Chromy: port:9230 --window-size=1024,768,--ignore-certificate-errors
Starting Chromy: port:9231 --window-size=320,480,--ignore-certificate-errors
Starting Chromy: port:9232 --window-size=600,600,--ignore-certificate-errors
(node:24649) MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 11 SIGINT listeners added. Use emitter.setMaxListeners() to increase limit
9223 LOG >  _READY
9224 LOG >  _READY
9222 LOG >  _READY
9230 LOG >  _READY
9227 LOG >  _READY
Starting Chromy: port:9233 --window-size=1024,768,--ignore-certificate-errors
9229 LOG >  _READY
9231 LOG >  _READY
9226 LOG >  _READY
9228 LOG >  _READY
Starting Chromy: port:9234 --window-size=320,480,--ignore-certificate-errors
9230 INFO >  readyEvent ok
9229 INFO >  readyEvent ok
9228 INFO >  readyEvent ok
Starting Chromy: port:9235 --window-size=600,600,--ignore-certificate-errors
Starting Chromy: port:9236 --window-size=1024,768,--ignore-certificate-errors
Starting Chromy: port:9237 --window-size=320,480,--ignore-certificate-errors
9232 LOG >  _READY
9233 LOG >  _READY
Starting Chromy: port:9238 --window-size=600,600,--ignore-certificate-errors
Starting Chromy: port:9239 --window-size=1024,768,--ignore-certificate-errors
Starting Chromy: port:9240 --window-size=320,480,--ignore-certificate-errors
Starting Chromy: port:9241 --window-size=600,600,--ignore-certificate-errors
9234 LOG >  _READY
Starting Chromy: port:9242 --window-size=1024,768,--ignore-certificate-errors
Starting Chromy: port:9243 --window-size=320,480,--ignore-certificate-errors
9239 LOG >  _READY
9235 LOG >  _READY
9238 LOG >  _READY
9237 LOG >  _READY
9236 LOG >  _READY
9240 LOG >  _READY
9241 LOG >  _READY
Starting Chromy: port:9244 --window-size=600,600,--ignore-certificate-errors
9242 LOG >  _READY
9243 LOG >  _READY
Starting Chromy: port:9245 --window-size=1024,768,--ignore-certificate-errors
Starting Chromy: port:9246 --window-size=320,480,--ignore-certificate-errors
Starting Chromy: port:9247 --window-size=600,600,--ignore-certificate-errors
9244 LOG >  _READY
Starting Chromy: port:9248 --window-size=1024,768,--ignore-certificate-errors
Starting Chromy: port:9249 --window-size=320,480,--ignore-certificate-errors
Starting Chromy: port:9250 --window-size=600,600,--ignore-certificate-errors
Starting Chromy: port:9251 --window-size=1024,768,--ignore-certificate-errors
9245 LOG >  _READY
Starting Chromy: port:9252 --window-size=320,480,--ignore-certificate-errors
Starting Chromy: port:9253 --window-size=600,600,--ignore-certificate-errors
9246 LOG >  _READY
9247 LOG >  _READY
9248 LOG >  _READY
Starting Chromy: port:9254 --window-size=1024,768,--ignore-certificate-errors
9249 LOG >  _READY
Starting Chromy: port:9255 --window-size=320,480,--ignore-certificate-errors
Starting Chromy: port:9256 --window-size=600,600,--ignore-certificate-errors
9250 LOG >  _READY
9251 LOG >  _READY
9252 LOG >  _READY
Starting Chromy: port:9257 --window-size=1024,768,--ignore-certificate-errors
Starting Chromy: port:9258 --window-size=320,480,--ignore-certificate-errors
>>>
[Function]
9253 LOG >  _READY
Starting Chromy: port:9259 --window-size=600,600,--ignore-certificate-errors
>>>
[Function]
Starting Chromy: port:9260 --window-size=1024,768,--ignore-certificate-errors
>>>
[Function]
9254 LOG >  _READY
9255 LOG >  _READY
Starting Chromy: port:9261 --window-size=320,480,--ignore-certificate-errors
onBefore.js is running for:  phone
Starting Chromy: port:9262 --window-size=600,600,--ignore-certificate-errors
onBefore.js is running for:  square
9256 LOG >  _READY
Starting Chromy: port:9263 --window-size=1024,768,--ignore-certificate-errors
onBefore.js is running for:  tablet_h
9257 LOG >  _READY
9258 LOG >  _READY
9259 LOG >  _READY
Starting Chromy: port:9264 --window-size=320,480,--ignore-certificate-errors
Starting Chromy: port:9265 --window-size=600,600,--ignore-certificate-errors
9258 LOG >  Testing viewport: phone
9259 LOG >  Testing viewport: square
Starting Chromy: port:9266 --window-size=1024,768,--ignore-certificate-errors
9260 LOG >  _READY
9260 LOG >  Testing viewport: tablet_h
Starting Chromy: port:9267 --window-size=320,480,--ignore-certificate-errors
Starting Chromy: port:9268 --window-size=600,600,--ignore-certificate-errors
9262 LOG >  _READY
9261 LOG >  _READY
Starting Chromy: port:9269 --window-size=1024,768,--ignore-certificate-errors
9263 LOG >  _READY
9264 LOG >  _READY
9265 LOG >  _READY
9264 INFO >  readyEvent ok
9265 INFO >  readyEvent ok
9266 LOG >  _READY
9266 INFO >  readyEvent ok
9267 LOG >  _READY
9268 LOG >  _READY
9267 INFO >  readyEvent ok
9268 INFO >  readyEvent ok
9269 LOG >  _READY
9269 INFO >  readyEvent ok
      COMMAND | Executing core for `report`
Uncaught exception: Stream not writable Error: Stream not writable
    at module.exports.ChunkStream.write (/Users/boriskaiser/.nvm/versions/node/v8.3.0/lib/node_modules/backstopjs/node_modules/pngjs/lib/chunkstream.js:46:24)
    at exports.PNG.PNG.write (/Users/boriskaiser/.nvm/versions/node/v8.3.0/lib/node_modules/backstopjs/node_modules/pngjs/lib/png.js:92:16)
    at ReadStream.ondata (_stream_readable.js:628:20)
    at emitOne (events.js:115:13)
    at ReadStream.emit (events.js:210:7)
    at addChunk (_stream_readable.js:252:12)
    at readableAddChunk (_stream_readable.js:239:11)
    at ReadStream.Readable.push (_stream_readable.js:197:10)
    at onread (fs.js:2003:12)
    at FSReqWrap.wrapper [as oncomplete] (fs.js:664:17)
/Users/boriskaiser/.nvm/versions/node/v8.3.0/lib/node_modules/backstopjs/cli/index.js:57
    throw err;
    ^

Error: Stream not writable
    at module.exports.ChunkStream.write (/Users/boriskaiser/.nvm/versions/node/v8.3.0/lib/node_modules/backstopjs/node_modules/pngjs/lib/chunkstream.js:46:24)
    at exports.PNG.PNG.write (/Users/boriskaiser/.nvm/versions/node/v8.3.0/lib/node_modules/backstopjs/node_modules/pngjs/lib/png.js:92:16)
    at ReadStream.ondata (_stream_readable.js:628:20)
    at emitOne (events.js:115:13)
    at ReadStream.emit (events.js:210:7)
    at addChunk (_stream_readable.js:252:12)
    at readableAddChunk (_stream_readable.js:239:11)
    at ReadStream.Readable.push (_stream_readable.js:197:10)
    at onread (fs.js:2003:12)
    at FSReqWrap.wrapper [as oncomplete] (fs.js:664:17)
boriskaiser commented 7 years ago

Hmm, I have disabled the retina mode on my mac and get the following result: screen shot 2017-08-21 at 20 09 53

I use:

_Here is the "backstopdata" folder as .zip: backstop_data.zip

BackstopJS v3.0.14
Loading config:  /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop.json

COMMAND | Executing core for `test`
createBitmaps | Selcted 16 of 16 scenarios.
Starting Chromy: port:9222 --window-size=320,480,--ignore-certificate-errors
Starting Chromy: port:9223 --window-size=600,600,--ignore-certificate-errors
Starting Chromy: port:9224 --window-size=1024,768,--ignore-certificate-errors
Starting Chromy: port:9225 --window-size=320,480,--ignore-certificate-errors
Starting Chromy: port:9226 --window-size=600,600,--ignore-certificate-errors
Starting Chromy: port:9227 --window-size=1024,768,--ignore-certificate-errors
Starting Chromy: port:9228 --window-size=320,480,--ignore-certificate-errors
Starting Chromy: port:9229 --window-size=600,600,--ignore-certificate-errors
Starting Chromy: port:9230 --window-size=1024,768,--ignore-certificate-errors
Starting Chromy: port:9231 --window-size=320,480,--ignore-certificate-errors
Starting Chromy: port:9232 --window-size=600,600,--ignore-certificate-errors
(node:27095) MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 11 SIGINT listeners added. Use emitter.setMaxListeners() to increase limit
Starting Chromy: port:9233 --window-size=1024,768,--ignore-certificate-errors
Starting Chromy: port:9234 --window-size=320,480,--ignore-certificate-errors
9229 LOG >  _READY
9222 LOG >  _READY
9231 LOG >  _READY
9228 LOG >  _READY
9223 LOG >  _READY
9224 LOG >  _READY
9229 INFO >  readyEvent ok
9228 INFO >  readyEvent ok
9230 LOG >  _READY
9230 INFO >  readyEvent ok
Starting Chromy: port:9235 --window-size=600,600,--ignore-certificate-errors
Starting Chromy: port:9236 --window-size=1024,768,--ignore-certificate-errors
Starting Chromy: port:9237 --window-size=320,480,--ignore-certificate-errors
Starting Chromy: port:9238 --window-size=600,600,--ignore-certificate-errors
9232 LOG >  _READY
9234 LOG >  _READY
Starting Chromy: port:9239 --window-size=1024,768,--ignore-certificate-errors
Starting Chromy: port:9240 --window-size=320,480,--ignore-certificate-errors
9233 LOG >  _READY
Starting Chromy: port:9241 --window-size=600,600,--ignore-certificate-errors
Starting Chromy: port:9242 --window-size=1024,768,--ignore-certificate-errors
Starting Chromy: port:9243 --window-size=320,480,--ignore-certificate-errors
9236 LOG >  _READY
9237 LOG >  _READY
9235 LOG >  _READY
9238 LOG >  _READY
9239 LOG >  _READY
9240 LOG >  _READY
9241 LOG >  _READY
Starting Chromy: port:9244 --window-size=600,600,--ignore-certificate-errors
9242 LOG >  _READY
9243 LOG >  _READY
Starting Chromy: port:9245 --window-size=1024,768,--ignore-certificate-errors
Starting Chromy: port:9246 --window-size=320,480,--ignore-certificate-errors
Starting Chromy: port:9247 --window-size=600,600,--ignore-certificate-errors
9244 LOG >  _READY
Starting Chromy: port:9248 --window-size=1024,768,--ignore-certificate-errors
Starting Chromy: port:9249 --window-size=320,480,--ignore-certificate-errors
Starting Chromy: port:9250 --window-size=600,600,--ignore-certificate-errors
Starting Chromy: port:9251 --window-size=1024,768,--ignore-certificate-errors
Starting Chromy: port:9252 --window-size=320,480,--ignore-certificate-errors
Starting Chromy: port:9253 --window-size=600,600,--ignore-certificate-errors
Starting Chromy: port:9254 --window-size=1024,768,--ignore-certificate-errors
9245 LOG >  _READY
9247 LOG >  _READY
9246 LOG >  _READY
9248 LOG >  _READY
9251 LOG >  _READY
9249 LOG >  _READY
9250 LOG >  _READY
9252 LOG >  _READY
Starting Chromy: port:9255 --window-size=320,480,--ignore-certificate-errors
Starting Chromy: port:9256 --window-size=600,600,--ignore-certificate-errors
Starting Chromy: port:9257 --window-size=1024,768,--ignore-certificate-errors
9253 LOG >  _READY
Starting Chromy: port:9258 --window-size=320,480,--ignore-certificate-errors
>>>
[Function]
Starting Chromy: port:9259 --window-size=600,600,--ignore-certificate-errors
>>>
[Function]
9254 LOG >  _READY
Starting Chromy: port:9260 --window-size=1024,768,--ignore-certificate-errors
>>>
[Function]
Starting Chromy: port:9261 --window-size=320,480,--ignore-certificate-errors
onBefore.js is running for:  phone
Starting Chromy: port:9262 --window-size=600,600,--ignore-certificate-errors
onBefore.js is running for:  square
Starting Chromy: port:9263 --window-size=1024,768,--ignore-certificate-errors
onBefore.js is running for:  tablet_h
9255 LOG >  _READY
Starting Chromy: port:9264 --window-size=320,480,--ignore-certificate-errors
Starting Chromy: port:9265 --window-size=600,600,--ignore-certificate-errors
9259 LOG >  _READY
9256 LOG >  _READY
9258 LOG >  _READY
9257 LOG >  _READY
9260 LOG >  _READY
9259 LOG >  Testing viewport: square
9258 LOG >  Testing viewport: phone
9260 LOG >  Testing viewport: tablet_h
Starting Chromy: port:9266 --window-size=1024,768,--ignore-certificate-errors
Starting Chromy: port:9267 --window-size=320,480,--ignore-certificate-errors
9261 LOG >  _READY
9262 LOG >  _READY
Starting Chromy: port:9268 --window-size=600,600,--ignore-certificate-errors
9264 LOG >  _READY
9263 LOG >  _READY
Starting Chromy: port:9269 --window-size=1024,768,--ignore-certificate-errors
9264 INFO >  readyEvent ok
9265 LOG >  _READY
9265 INFO >  readyEvent ok
9267 LOG >  _READY
9266 LOG >  _READY
9268 LOG >  _READY
9267 INFO >  readyEvent ok
9266 INFO >  readyEvent ok
9269 LOG >  _READY
9268 INFO >  readyEvent ok
9269 INFO >  readyEvent ok
      COMMAND | Executing core for `report`
      compare | ERROR { requireSameDimensions: false size: ok, content: 11.68%, threshold: 0.1% }: notExpanded sanity_test_notExpanded_0_body_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_notExpanded_0_body_0_phone.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 5.11%, threshold: 0.1% }: notExpanded sanity_test_notExpanded_1_pagination_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_notExpanded_1_pagination_0_phone.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.75%, threshold: 0.1% }: notExpanded sanity_test_notExpanded_4_page-itemnth-child3page-link_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_notExpanded_4_page-itemnth-child3page-link_0_phone.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 1.77%, threshold: 0.1% }: notExpanded sanity_test_notExpanded_2_page-itemnth-child1page-link_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_notExpanded_2_page-itemnth-child1page-link_0_phone.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 1.24%, threshold: 0.1% }: notExpanded sanity_test_notExpanded_6_page-itemnth-child5page-link_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_notExpanded_6_page-itemnth-child5page-link_0_phone.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.75%, threshold: 0.1% }: notExpanded sanity_test_notExpanded_5_page-itemnth-child4page-link_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_notExpanded_5_page-itemnth-child4page-link_0_phone.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.75%, threshold: 0.1% }: notExpanded sanity_test_notExpanded_3_page-itemnth-child2page-link_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_notExpanded_3_page-itemnth-child2page-link_0_phone.png
      compare | ERROR { requireSameDimensions: false size: ok, content: 8.05%, threshold: 0.1% }: notExpanded sanity_test_notExpanded_0_body_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_notExpanded_0_body_1_square.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 3.10%, threshold: 0.1% }: noSelectors sanity_test_noSelectors_0_document_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_noSelectors_0_document_0_phone.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 3.15%, threshold: 0.1% }: noSelectors_noReadyOrDelayProps sanity_test_noSelectors_noReadyOrDelayProps_0_document_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_noSelectors_noReadyOrDelayProps_0_document_0_phone.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 3.10%, threshold: 0.1% }: noSelectors_readyEvent sanity_test_noSelectors_readyEvent_0_document_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_noSelectors_readyEvent_0_document_0_phone.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 3.10%, threshold: 0.1% }: noSelectors_delay sanity_test_noSelectors_delay_0_document_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_noSelectors_delay_0_document_0_phone.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 2.19%, threshold: 0.1% }: notExpanded sanity_test_notExpanded_1_pagination_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_notExpanded_1_pagination_1_square.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.76%, threshold: 0.1% }: notExpanded sanity_test_notExpanded_2_page-itemnth-child1page-link_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_notExpanded_2_page-itemnth-child1page-link_1_square.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.32%, threshold: 0.1% }: notExpanded sanity_test_notExpanded_3_page-itemnth-child2page-link_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_notExpanded_3_page-itemnth-child2page-link_1_square.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.32%, threshold: 0.1% }: notExpanded sanity_test_notExpanded_5_page-itemnth-child4page-link_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_notExpanded_5_page-itemnth-child4page-link_1_square.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.32%, threshold: 0.1% }: notExpanded sanity_test_notExpanded_4_page-itemnth-child3page-link_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_notExpanded_4_page-itemnth-child3page-link_1_square.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.53%, threshold: 0.1% }: notExpanded sanity_test_notExpanded_6_page-itemnth-child5page-link_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_notExpanded_6_page-itemnth-child5page-link_1_square.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 3.43%, threshold: 0.1% }: noSelectors sanity_test_noSelectors_0_document_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_noSelectors_0_document_1_square.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 3.55%, threshold: 0.1% }: noSelectors_noReadyOrDelayProps sanity_test_noSelectors_noReadyOrDelayProps_0_document_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_noSelectors_noReadyOrDelayProps_0_document_1_square.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 3.43%, threshold: 0.1% }: noSelectors_readyEvent sanity_test_noSelectors_readyEvent_0_document_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_noSelectors_readyEvent_0_document_1_square.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 3.43%, threshold: 0.1% }: noSelectors_delay sanity_test_noSelectors_delay_0_document_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_noSelectors_delay_0_document_1_square.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 5.11%, threshold: 0.1% }: isExpanded sanity_test_isExpanded_1_pagination_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_1_pagination_0_phone.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 1.77%, threshold: 0.1% }: isExpanded sanity_test_isExpanded_2_page-itempage-link_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_2_page-itempage-link_0_phone.png
      compare | ERROR { requireSameDimensions: false size: ok, content: 11.68%, threshold: 0.1% }: isExpanded sanity_test_isExpanded_0_body_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_0_body_0_phone.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.75%, threshold: 0.1% }: isExpanded sanity_test_isExpanded_3_page-itempage-link__n1_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_3_page-itempage-link__n1_0_phone.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.75%, threshold: 0.1% }: isExpanded sanity_test_isExpanded_4_page-itempage-link__n2_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_4_page-itempage-link__n2_0_phone.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 5.05%, threshold: 0.1% }: noSelectors sanity_test_noSelectors_0_document_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_noSelectors_0_document_2_tablet_h.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 5.07%, threshold: 0.1% }: noSelectors_noReadyOrDelayProps sanity_test_noSelectors_noReadyOrDelayProps_0_document_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_noSelectors_noReadyOrDelayProps_0_document_2_tablet_h.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 5.05%, threshold: 0.1% }: noSelectors_readyEvent sanity_test_noSelectors_readyEvent_0_document_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_noSelectors_readyEvent_0_document_2_tablet_h.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 5.05%, threshold: 0.1% }: noSelectors_delay sanity_test_noSelectors_delay_0_document_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_noSelectors_delay_0_document_2_tablet_h.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.75%, threshold: 0.1% }: isExpanded sanity_test_isExpanded_5_page-itempage-link__n3_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_5_page-itempage-link__n3_0_phone.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 1.24%, threshold: 0.1% }: isExpanded sanity_test_isExpanded_6_page-itempage-link__n4_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_6_page-itempage-link__n4_0_phone.png
      compare | ERROR { requireSameDimensions: false size: ok, content: 7.44%, threshold: 0.1% }: notExpanded sanity_test_notExpanded_0_body_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_notExpanded_0_body_2_tablet_h.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 2.19%, threshold: 0.1% }: isExpanded sanity_test_isExpanded_1_pagination_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_1_pagination_1_square.png
      compare | ERROR { requireSameDimensions: false size: ok, content: 7.96%, threshold: 0.1% }: isExpanded sanity_test_isExpanded_0_body_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_0_body_1_square.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.76%, threshold: 0.1% }: isExpanded sanity_test_isExpanded_2_page-itempage-link_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_2_page-itempage-link_1_square.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.32%, threshold: 0.1% }: isExpanded sanity_test_isExpanded_3_page-itempage-link__n1_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_3_page-itempage-link__n1_1_square.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.32%, threshold: 0.1% }: isExpanded sanity_test_isExpanded_4_page-itempage-link__n2_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_4_page-itempage-link__n2_1_square.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.32%, threshold: 0.1% }: isExpanded sanity_test_isExpanded_5_page-itempage-link__n3_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_5_page-itempage-link__n3_1_square.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.53%, threshold: 0.1% }: isExpanded sanity_test_isExpanded_6_page-itempage-link__n4_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_6_page-itempage-link__n4_1_square.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 1.00%, threshold: 0.1% }: notExpanded sanity_test_notExpanded_1_pagination_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_notExpanded_1_pagination_2_tablet_h.png
      compare | ERROR { requireSameDimensions: false size: ok, content: 11.68%, threshold: 0.1% }: isExpanded_viewport sanity_test_isExpanded_viewport_0_viewport_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_viewport_0_viewport_0_phone.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.35%, threshold: 0.1% }: notExpanded sanity_test_notExpanded_2_page-itemnth-child1page-link_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_notExpanded_2_page-itemnth-child1page-link_2_tablet_h.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.15%, threshold: 0.1% }: notExpanded sanity_test_notExpanded_3_page-itemnth-child2page-link_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_notExpanded_3_page-itemnth-child2page-link_2_tablet_h.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.15%, threshold: 0.1% }: notExpanded sanity_test_notExpanded_4_page-itemnth-child3page-link_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_notExpanded_4_page-itemnth-child3page-link_2_tablet_h.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.15%, threshold: 0.1% }: notExpanded sanity_test_notExpanded_5_page-itemnth-child4page-link_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_notExpanded_5_page-itemnth-child4page-link_2_tablet_h.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 5.11%, threshold: 0.1% }: isExpanded_viewport sanity_test_isExpanded_viewport_1_pagination_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_viewport_1_pagination_0_phone.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.75%, threshold: 0.1% }: isExpanded_viewport sanity_test_isExpanded_viewport_3_page-itempage-link__n1_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_viewport_3_page-itempage-link__n1_0_phone.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.75%, threshold: 0.1% }: isExpanded_viewport sanity_test_isExpanded_viewport_4_page-itempage-link__n2_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_viewport_4_page-itempage-link__n2_0_phone.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 1.77%, threshold: 0.1% }: isExpanded_viewport sanity_test_isExpanded_viewport_2_page-itempage-link_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_viewport_2_page-itempage-link_0_phone.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.75%, threshold: 0.1% }: isExpanded_viewport sanity_test_isExpanded_viewport_5_page-itempage-link__n3_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_viewport_5_page-itempage-link__n3_0_phone.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 1.24%, threshold: 0.1% }: isExpanded_viewport sanity_test_isExpanded_viewport_6_page-itempage-link__n4_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_viewport_6_page-itempage-link__n4_0_phone.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.24%, threshold: 0.1% }: notExpanded sanity_test_notExpanded_6_page-itemnth-child5page-link_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_notExpanded_6_page-itemnth-child5page-link_2_tablet_h.png
      compare | ERROR { requireSameDimensions: false size: ok, content: 7.96%, threshold: 0.1% }: isExpanded_viewport sanity_test_isExpanded_viewport_0_viewport_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_viewport_0_viewport_1_square.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 2.19%, threshold: 0.1% }: isExpanded_viewport sanity_test_isExpanded_viewport_1_pagination_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_viewport_1_pagination_1_square.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.76%, threshold: 0.1% }: isExpanded_viewport sanity_test_isExpanded_viewport_2_page-itempage-link_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_viewport_2_page-itempage-link_1_square.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.32%, threshold: 0.1% }: isExpanded_viewport sanity_test_isExpanded_viewport_3_page-itempage-link__n1_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_viewport_3_page-itempage-link__n1_1_square.png
      compare | OK: notVisible sanity_test_notVisible_0_displayNone_0_phone.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.32%, threshold: 0.1% }: isExpanded_viewport sanity_test_isExpanded_viewport_4_page-itempage-link__n2_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_viewport_4_page-itempage-link__n2_1_square.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.32%, threshold: 0.1% }: isExpanded_viewport sanity_test_isExpanded_viewport_5_page-itempage-link__n3_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_viewport_5_page-itempage-link__n3_1_square.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 1.00%, threshold: 0.1% }: isExpanded sanity_test_isExpanded_1_pagination_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_1_pagination_2_tablet_h.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.53%, threshold: 0.1% }: isExpanded_viewport sanity_test_isExpanded_viewport_6_page-itempage-link__n4_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_viewport_6_page-itempage-link__n4_1_square.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.35%, threshold: 0.1% }: isExpanded sanity_test_isExpanded_2_page-itempage-link_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_2_page-itempage-link_2_tablet_h.png
      compare | OK: notVisible sanity_test_notVisible_0_displayNone_1_square.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.15%, threshold: 0.1% }: isExpanded sanity_test_isExpanded_3_page-itempage-link__n1_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_3_page-itempage-link__n1_2_tablet_h.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.15%, threshold: 0.1% }: isExpanded sanity_test_isExpanded_4_page-itempage-link__n2_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_4_page-itempage-link__n2_2_tablet_h.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.15%, threshold: 0.1% }: isExpanded sanity_test_isExpanded_5_page-itempage-link__n3_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_5_page-itempage-link__n3_2_tablet_h.png
      compare | OK: notVisible sanity_test_notVisible_0_displayNone_2_tablet_h.png
      compare | OK: notFound sanity_test_notFound_0_monkey_0_phone.png
      compare | OK: notFound sanity_test_notFound_0_monkey_1_square.png
      compare | OK: notFound sanity_test_notFound_0_monkey_2_tablet_h.png
      compare | OK: notFound_expanded sanity_test_notFound_expanded_0_monkey_0_phone.png
      compare | OK: notFound_expanded sanity_test_notFound_expanded_0_monkey_1_square.png
      compare | OK: notFound_expanded sanity_test_notFound_expanded_0_monkey_2_tablet_h.png
      compare | ERROR { requireSameDimensions: false size: ok, content: 7.29%, threshold: 0.1% }: isExpanded sanity_test_isExpanded_0_body_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_0_body_2_tablet_h.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.24%, threshold: 0.1% }: isExpanded sanity_test_isExpanded_6_page-itempage-link__n4_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_6_page-itempage-link__n4_2_tablet_h.png
      compare | ERROR { requireSameDimensions: false size: ok, content: 0.74%, threshold: 0.1% }: hideSelectors sanity_test_hideSelectors_0_body_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_hideSelectors_0_body_0_phone.png
      compare | ERROR { requireSameDimensions: false size: ok, content: 10.19%, threshold: 0.1% }: onReadyScript sanity_test_onReadyScript_0_body_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_onReadyScript_0_body_0_phone.png
      compare | ERROR { requireSameDimensions: false size: ok, content: 15.28%, threshold: 0.1% }: removeSelectors sanity_test_removeSelectors_0_body_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_removeSelectors_0_body_0_phone.png
      compare | ERROR { requireSameDimensions: false size: ok, content: 29.29%, threshold: 0.1% }: onBeforeScript sanity_test_onBeforeScript_0_body_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_onBeforeScript_0_body_0_phone.png
      compare | ERROR { requireSameDimensions: false size: ok, content: 18.86%, threshold: 10% }: misMatchThreshold sanity_test_misMatchThreshold_0_body_0_phone.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_misMatchThreshold_0_body_0_phone.png
      compare | ERROR { requireSameDimensions: false size: ok, content: 6.42%, threshold: 0.1% }: hideSelectors sanity_test_hideSelectors_0_body_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_hideSelectors_0_body_1_square.png
      compare | OK: requireSameDimensions sanity_test_requireSameDimensions_0_body_0_phone.png
      compare | ERROR { requireSameDimensions: false size: ok, content: 10.13%, threshold: 0.1% }: onReadyScript sanity_test_onReadyScript_0_body_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_onReadyScript_0_body_1_square.png
      compare | ERROR { requireSameDimensions: false size: ok, content: 10.24%, threshold: 0.1% }: removeSelectors sanity_test_removeSelectors_0_body_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_removeSelectors_0_body_1_square.png
      compare | ERROR { requireSameDimensions: false size: ok, content: 13.04%, threshold: 0.1% }: onBeforeScript sanity_test_onBeforeScript_0_body_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_onBeforeScript_0_body_1_square.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 1.00%, threshold: 0.1% }: isExpanded_viewport sanity_test_isExpanded_viewport_1_pagination_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_viewport_1_pagination_2_tablet_h.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.35%, threshold: 0.1% }: isExpanded_viewport sanity_test_isExpanded_viewport_2_page-itempage-link_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_viewport_2_page-itempage-link_2_tablet_h.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.15%, threshold: 0.1% }: isExpanded_viewport sanity_test_isExpanded_viewport_3_page-itempage-link__n1_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_viewport_3_page-itempage-link__n1_2_tablet_h.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.15%, threshold: 0.1% }: isExpanded_viewport sanity_test_isExpanded_viewport_4_page-itempage-link__n2_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_viewport_4_page-itempage-link__n2_2_tablet_h.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.15%, threshold: 0.1% }: isExpanded_viewport sanity_test_isExpanded_viewport_5_page-itempage-link__n3_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_viewport_5_page-itempage-link__n3_2_tablet_h.png
      compare | ERROR { requireSameDimensions: false size: ok, content: 7.29%, threshold: 0.1% }: isExpanded_viewport sanity_test_isExpanded_viewport_0_viewport_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_viewport_0_viewport_2_tablet_h.png
      compare | ERROR { requireSameDimensions: false size: ok, content: 14.51%, threshold: 10% }: misMatchThreshold sanity_test_misMatchThreshold_0_body_1_square.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_misMatchThreshold_0_body_1_square.png
      compare | ERROR { requireSameDimensions: false size: isDifferent, content: 0.24%, threshold: 0.1% }: isExpanded_viewport sanity_test_isExpanded_viewport_6_page-itempage-link__n4_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_isExpanded_viewport_6_page-itempage-link__n4_2_tablet_h.png
      compare | ERROR { requireSameDimensions: false size: ok, content: 10.33%, threshold: 0.1% }: hideSelectors sanity_test_hideSelectors_0_body_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_hideSelectors_0_body_2_tablet_h.png
      compare | ERROR { requireSameDimensions: false size: ok, content: 5.09%, threshold: 0.1% }: removeSelectors sanity_test_removeSelectors_0_body_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_removeSelectors_0_body_2_tablet_h.png
      compare | ERROR { requireSameDimensions: false size: ok, content: 12.38%, threshold: 0.1% }: onReadyScript sanity_test_onReadyScript_0_body_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_onReadyScript_0_body_2_tablet_h.png
      compare | ERROR { requireSameDimensions: false size: ok, content: 7.86%, threshold: 0.1% }: onBeforeScript sanity_test_onBeforeScript_0_body_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_onBeforeScript_0_body_2_tablet_h.png
      compare | ERROR { requireSameDimensions: false size: ok, content: 15.96%, threshold: 10% }: misMatchThreshold sanity_test_misMatchThreshold_0_body_2_tablet_h.png
   See: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/bitmaps_test/20170821-200619/failed_diff_sanity_test_misMatchThreshold_0_body_2_tablet_h.png
      compare | OK: requireSameDimensions sanity_test_requireSameDimensions_0_body_2_tablet_h.png
      compare | OK: requireSameDimensions sanity_test_requireSameDimensions_0_body_1_square.png
       report | Test completed...
       report | 12 Passed
       report | 90 Failed
       report | Writing browser report
       report | Browser reported copied
       report | Copied configuration to: /Users/boriskaiser/Sites/tests/backstop-feature-tests/backstop_data/html_report/config.js
      COMMAND | Executing core for `openReport`
   openReport | Opening report.
      COMMAND | Command `openReport` sucessfully executed in [0.077s]
       report | *** Mismatch errors found ***
       report | For a detailed report run `backstop openReport`

      COMMAND | Command `report` ended with an error after [13.861s]
      COMMAND | Error: Mismatch errors found.
                    at /Users/boriskaiser/.nvm/versions/node/v8.3.0/lib/node_modules/backstopjs/core/command/report.js:113:17
                    at <anonymous>
                    at process._tickCallback (internal/process/next_tick.js:188:7)
      COMMAND | Command `test` ended with an error after [45.502s]
      COMMAND | Error: Mismatch errors found.
                    at /Users/boriskaiser/.nvm/versions/node/v8.3.0/lib/node_modules/backstopjs/core/command/report.js:113:17
                    at <anonymous>
                    at process._tickCallback (internal/process/next_tick.js:188:7)
boriskaiser commented 7 years ago

Eureka! 🚀 🚀 🚀 After uninstalling Chrome Canary, it works as expected, see here: image

FYI

@garris Thanks for your support! 🙇

boriskaiser commented 7 years ago

FYI#2 It works well with the current version of Chrome Canary (v62.0.3192.0): image

garris commented 7 years ago

Great to hear! Cheers

mirzazeyrek commented 7 years ago

@boriskaiser I think it would work fine with different versions if you try "backstop reference && backstop test"

There could be font rendering differences between different chrome versions.

And is footer selector works fine with different chrome versions ?