bcgov / cas-cif

CleanBC Industry Fund project
Apache License 2.0
6 stars 2 forks source link

Spurious happo diffs #1194

Open dleard opened 1 year ago

dleard commented 1 year ago

The following happo diffs were causing issues in CI by flip-flopping and have been commented out:

Emisisons intensity report form - with errors:

Index.spec - renders the IA-specific unfilled project forms:

create-subsequent-project-revision.spec - displays updated forms in a project revision/amendment:

IA Project funding agreement Form - with errors:

After upgrading Cypress to version 12, we get happo diffs on many pages mainly on Safari and Edge browsers. this diff is mainly around some texts on some pages. an example: Screenshot 2023-03-22 at 8.27.49 AM.png

Dev checklist:

BCerki commented 1 year ago

Lindsay, there's nothing to see in dev on this one

LindsayMacfarlane commented 1 year ago

Awesome - thanks @BCerki ! We can probably move into Accepted by PO/Dev column

BCerki commented 1 year ago

This is still a problem, e.g. this report

BCerki commented 1 year ago

Commented out problem diffs in /home/briannacerkiewicz/cas-cif/app/cypress/integration/cif/project-revision/index.spec.js:

pbastia commented 1 year ago

An avenue to explore: we use cypress 12, but the happo package wants cypress 10

BCerki commented 1 year ago

If we decide to address this by removing screenshots, I'd suggest adding some cypress assertions for calculated values. Sometimes happo is the only thing that catches changes to the calculations that use values from multiple forms

pbastia commented 1 year ago

idea: remove iOS browsers from happo, they generate spurious diffs after validating the user percentage with our analytics