Is your feature request related to a problem? Please describe.
There are now 100s of test cases in the test directory, to verify the repo it takes a long time to run all tests. This makes it difficult to check the core functionality of the package for developer locally.
Describe the solution you'd like
Start categorizing tests into L0-L2 where L0 has broad code coverage and checks critical use cases with edge case tests being run in L1 and L2 tests reserved for tests that need specific configurations (quantization, multigpu, etc.)
Describe alternatives you've considered
We already have the nox system, not sure if we want to build off this or use something else.
Is your feature request related to a problem? Please describe.
There are now 100s of test cases in the test directory, to verify the repo it takes a long time to run all tests. This makes it difficult to check the core functionality of the package for developer locally.
Describe the solution you'd like
Start categorizing tests into L0-L2 where L0 has broad code coverage and checks critical use cases with edge case tests being run in L1 and L2 tests reserved for tests that need specific configurations (quantization, multigpu, etc.)
Describe alternatives you've considered
We already have the nox system, not sure if we want to build off this or use something else.
Additional context