search

unity-sds / unity-system-test

System Test area of the Unity Repository
Apache License 2.0
1 stars 2 forks source link

Shared Service Validation Tests #14

Closed mike-gangl closed 3 months ago

mike-gangl commented 8 months ago

Define Validation Tests for Shared Services (non-functional)

Acceptance Criteria:

As managed services, these must also fulfill managed services requirements:

Identifier | Level | Requirements -- | -- | -- MDPS_2_REQ-170 | L3 | The MDPS shall support the previous major version of managed services MDPS_2_REQ-111 | L3 | MDPS managed services shall provide the means to continuously integrate and deploy MDPS software MDPS_2_REQ-110 | L3 | MDPS managed services shall provide a common deployment mechanism MDPS_2_REQ-114 | L3 | MDPS managed services shall provide a common upgrade mechanism MDPS_2_REQ-115 | L3 | MDPS managed services shall provide a common rollback mechanism, except where prohibited by other requirements and policies MDPS_2_REQ-158 | L3 | MDPS managed services shall allow resource customization MDPS_2_REQ-159 | L3 | MDPS managed services shall report health metrics MDPS_2_REQ-182 | L3 | MDPS managed services shall be automatically validated upon deployment or rollback MDPS_2_REQ-196 | L3 | MDPS managed services shall be capable of alerting users based on health metrics
mike-gangl commented 8 months ago

did a preliminary run-through for "shared services" that need to be validated, and have the following set of components to test:

apgs - https://github.com/unity-sds/unity-system-test/tree/main/features/apgs
application_catalog - https://github.com/unity-sds/unity-system-test/tree/main/features/application_catalog
core_services - https://github.com/unity-sds/unity-system-test/tree/main/features/core_services
data_catalog - https://github.com/unity-sds/unity-system-test/tree/main/features/data_catalog
project_isolation - https://github.com/unity-sds/unity-system-test/tree/main/features/project_isolation
security - 
workflow_authoring_tool - N/A Out of prototype scope
workflow_catalog - https://github.com/unity-sds/unity-system-test/tree/main/features/workflow_catalog
GodwinShen commented 7 months ago

@mike-gangl any updates on this one? Is this something that @brianlee731 or @GodwinShen can help test?

mike-gangl commented 6 months ago

The test plan has been written, but the procedure has not been 'implemented'. i'll go back and check where i left off with this and how these tests were marked as shared service validation tests.

brianlee731 commented 5 months ago

I noticed that there is one feature file for multiple requirements (indicated in the table). Is this required? I'm starting to realize that it might be best to create multiple feature files... @mike-gangl your thoughts? we can talk about this tomorrow during our tag-up.

GodwinShen commented 4 months ago

@brianlee731 ping for status

brianlee731 commented 4 months ago

The direction was to focus on the following requirements shown here: https://github.com/unity-sds/unity-project-management/blob/main/docs/phase_2_requirements.csv

The current status is that we've writing out the validation tests on Testrail and executing them. Link to testrail: https://cae-testrail.jpl.nasa.gov/testrail/index.php?/milestones/view/2080