search

jekyll / Utterson

CI benchmarking suite for Jekyll
MIT License
13 stars 8 forks source link

Add regression testing #51

Open pathawks opened 6 years ago

pathawks commented 6 years ago

This provides a way of performing regression testing on generated sites.

If the base branch is built with DESTINATION_DIR="old" ./bench and the head branch is built with DESTINATION_DIR="new" ./bench, then one can run OLD="old" NEW="new" ./regression to see a diff of the two builds. If there are any differences, regression will exit with a non-zero status.

This is not yet automated. That might be a bit more work.

pathawks commented 6 years ago

Anything that outputs a timestamp borks the diff 😓