Add visual regression tests

saundefined commented 1 month ago

/cc @pronskiy

github-actions[bot] commented 1 month ago

🚀 Commit d7d2735822a88702c6888a65c9d8d3b57e7c34a7 Deployed on https://web-php-pr-994.preview.thephp.foundation

pronskiy commented 1 month ago

Going through the list of PRs and issues, we can see that there are a bunch of UI/CSS things. The problem is that we currently do not have any experts in this area, and moreover, no QA experts to verify if the changes do not break something.

With this PR Sergey and I propose to introduce screenshot regression testing.

It works like this:

Creates snapshots of the website.
Then for (almost) every PR creates a new screenshot after changes and compares it to a snapshot.
If there is an unexpected difference between two screenshots, then this is a regression introduced and PR should be fixed.

We'd like your feedback on this idea. And if it makes sense, we'll implement the missing parts.

saundefined commented 4 weeks ago

Example: https://github.com/saundefined/web-php/pull/21 Report: https://web-php-snapshot-pr-21.preview.thephp.foundation/

php / web-php

Add visual regression tests #994