Create and run test to ensure data is captured correctly

fongcindy commented 3 months ago

Description

Nick P noticed on 6/11 a bug in the funnel data caused some inaccurate data. Most of the event data is gone after March 27.

Let's look into creating a E2E testing that can ensure that the data is being captured correctly and working.

User Story

As a data analyst I would like to ensure that any structural DOM changes that occur, which could impact data gathering, is alerted to developers before code release
As a data analyst I would like to be made aware of loss of data that supports critical business in an automated way
As a developer I would like to be made aware of impacts my code change might make to data gathering by seeing a failing test
As a Benefit Finder team member, I would like to be made aware of critical business data at the end of a sprint

Acceptance Criteria

[ ] weekly report in email form of critical business data measurements, includes BXTEAM, PXPO, delivered at end of sprint
[ ] e2e test to cover critical business events established for data collection, ie. custom selectors, data-analytic attributes

scottqueen-bixal commented 3 months ago

@nick - we can sync to determine a plan for what and how you are going to make updates. We can then back map this plan into the requirements for trying to establish some automated testing.

scottqueen-bixal commented 3 months ago

removing myself since we are tracking in another ticket, recommend updating this to conform more closely to consistent data reporting to prevent uknown/late loss of data - cc @fongcindy

nickpistone commented 3 months ago

@fongcindy what are you looking for with this ticket? Is this about QA for the new data collection to make sure it's coming in or more about setting up a QA process moving forward?

fongcindy commented 3 months ago

@nickpistone Yes, the DoD is the QA for the data collection (+e2e test) and a weekly report out of the data to stakeholders

fongcindy commented 2 months ago

Might be a duplicate ticket, confirm

GSA / px-benefit-finder