plantinformatics / pretzel

Javascript full-stack framework for Big Data visualisation and analysis
GNU General Public License v3.0
42 stars 13 forks source link

outline of testing process #37

Open Don-Isdale opened 6 years ago

Don-Isdale commented 6 years ago

test elements :

automated testing using URLs to define the test cases, the URLs are rendered (e.g. headless browser) and SVG and/or PNG is exported history of the exports is retained, for automatic comparison; test report shows where results do not match the previously accepted results; the test engineer will check the variation and variation is of the SVG is shown by text diff; variation of the PNG is shown as a red region where there are differences

There are tools which implement this PNG comparison test method Survey of screenshot-based CSS testing tools · GitHub https://gist.github.com/cvrebert/adf91e429906a4d746cd

percy.io/

Screener.io: Automated Visual Testing https://screener.io/

Visual Regression Testing - Home https://visualregressiontesting.com/

Show HN: Percy.io, a continuous visual integration tool | Hacker News https://news.ycombinator.com/item?id=9624673

Don-Isdale commented 6 years ago

Good overview of some modules to use for maintenable testing : Maintainable User Interface Testing with Ember (posted in slack #general)

Don-Isdale commented 5 years ago

Additional tools :

https://github.com/storybooks/storybook/issues/26 discussion mentions : https://github.com/Huddle/PhantomCSS#phantomcss https://css-tricks.com/automating-css-regression-testing/#post-240096 https://github.com/Galooshi/happo http://huddle.github.io/Resemble.js/ "BackstopJS is a wrapper around resemble"

https://www.slideshare.net/OnurBaskirt/colorful-worldofvisualautomationtestinglatest

https://storybook.js.org/docs/testing/automated-visual-testing/

https://www.chromaticqa.com/compare/percy

(from https://medium.freecodecamp.org/a-look-back-at-the-state-of-javascript-in-2017-a5b7f562e977) " Jest has exploded and has surpassed Jasmine in NPM downloads.

Jest supports snapshot testing, I’ve seen lots of people using snapshotting as a cheaper alternative to unit tests for basic input/output behavior. This is especially popular in the UI space, with Storyshots, as well a whole ecosystem of related tools such as Loki, Percy, Screener, and Chromatic."