department-of-veterans-affairs / va.gov-team

Public resources for building on and in support of VA.gov. Visit complete Knowledge Hub:
https://depo-platform-documentation.scrollhelp.site/index.html
284 stars 206 forks source link

Conduct discussion with PRT SMEs regarding `vets-api` test consistency #90508

Closed pjhill closed 3 months ago

pjhill commented 3 months ago

Description

In order to get a better understanding of the current vets-api local vs. CI testing experience, we will conduct a discussion with back-end engineers working with the Platform Reliability Team. Discussion should include deficiencies in local testing of vets-api, desired features in the local testing environment, key discrepancies between test execution locally vs. in the CI pipeline, and pitfalls associated with vets-api testing.

Tasks

Acceptance Criteria

IGallupSoCo commented 3 months ago

On a semi-related note, Ben noted that the Platform has the resources to provide users like me (who run into frustrating hardware limitations) with a virtual machine that would have far more processing power available to perform "local" testing.

I suspect that this thread could be worth pursuing within this epic's efforts.

IGallupSoCo commented 3 months ago

There are gems like TestProf that would have the potential to further streamline local testing. GitLab reportedly reduced their API test timeline by 39%. Ryan has a ticket in the backlog to explore such solutions.

IGallupSoCo commented 3 months ago

My discovery and research notes can be found here.