CDCgov / prime-reportstream

ReportStream is a public intermediary tool for delivery of data between different parts of the healthcare ecosystem.
https://reportstream.cdc.gov
Creative Commons Zero v1.0 Universal
69 stars 39 forks source link

[SPIKE] Identify how to add support within the E2E testing architecture to allow choosing what data to run E2E tests against #14210

Closed chris-kuryak closed 2 months ago

chris-kuryak commented 4 months ago

Problem statement

E2E tests always querying against Staging data is causing a large number of exceptions and PagerDuty alerts. To prevent this from happening, we want to allow E2E tests to run against different types of data including Local, Mock, Staging, and Live.

What you need to know

Acceptance criteria

penny-lischer commented 2 months ago

We now have a flag called isMockDisabled that when set to true, will run the tests against non mock data.

To run the smoke tests we would need to add a github action that runs the following command: yarn run test:e2e-smoke The smoke tests will run against the data on which the tests are being run on.

To run a test or group of tests as part of the smoke test, you will need to add a tag to the test or group of tests. i,e.

test.describe(
            "Group of tests",
            {
                tag: "@smoke",
            },
            () => {
                test("a single test", async ({
                    page,
                }) => {
                 ... testing something
               });
   });
penny-lischer commented 2 months ago

Follow on tickets: 15057 15059