defenseunicorns / leapfrogai

Production-ready Generative AI for local, cloud native, airgap, and edge deployments.
https://leapfrog.ai
Apache License 2.0
253 stars 29 forks source link

chore(test): Consolidated Testing Strategy #581

Closed alekst23 closed 2 months ago

alekst23 commented 4 months ago

Describe what should be investigated or refactored

We need to have a consolidated and clearly defined approach to testing our systems. Currently, we don't have a clear definition of what features and functions should be test at each level, and we mix some integration and system testing.

It is also currently difficult for new developers to spin up a test suite in a new environment. We should have tests work out of the box.

Proposed solution

We should create an ADR or another artifact to record our testing strategy and approach.

We should define the levels of testing (ie. Unit, Integration, System), and the features to test in each level.

We should then refactor existing code to achieve our testing goals.

We should account for testing on various OS types and in K8