QA Test Cases made public and traceability evident from requirements through to case

[euanmillar]

June 2022 release (v1) must be fully tested both functionally and technically and these test results will be made public. This means:

1. Full traceability from requirements to test cases (manual / automated E2E / performance) and scenarios
2. Full test coverage showing the test cycles and cases fully run
3. Defect reports showing:
   • the number of defects that have been found and their severity
   • the number of defects that remain open (not fixed) and their severity
4. Test cases made publicly available for system integrators to use on their projects

• We need to be able to trace from requirements through to specific test cases to ensure that we are testing all functionality (including configuration requirements, NFRs etc.), via epics, designs, user stories etc.
• A test case is not static. It can be used for a number of scenarios, which together make up the full test coverage, well beyond positive and negative test cases.
• We need to keep clear separation of testing from development i.e. we need to test the requirement and what was designed rather than what has been built.

[rikukissa]

@euanmillar @Zangetsu101 @SyedaAfrida I like this idea. There's currently a disconnect between TestRail and the E2E tests which we should try to fix.

[euanmillar]

@SyedaAfrida we need to investigate migrating from a DSI owned TestRail to an OpenCRVS owned account. We are going to need more users from across a global team.

[SyedaAfrida]

@euanmillar @rikukissa In Testrail we have option to export and import testcase. So we can export from DSI owned testrail account to an OpenCRVS owned account. Few more observation-

1. We can integrate testrail with github to identify which testcase are getting failed for which defect
2. We can integrate testrail with playwright if we want our e2e reports through testrail. I dont think this is going to serve our purpose. In this case what can be done is, whenever any QA is updating or creating any testcase, they need to create a ticket mentioning to write e2e for that testcase.
3. When any new testcase is added for any feature, those ticket can be placed in reference for that testcase
4. For system integrators there is option to provide view only option