Closed riedgar-ms closed 2 weeks ago
This is just a beginning; I've not started redoing the workflow files yet.
Also note that some files (e.g. test_model.py
and test_grammar.py
have been split into two between unit
and model_integration
according to whether each test needs a real model or not.
@riedgar-ms thanks for the work on this. I think the logical separation between types of tests makes sense, and upon thinking about it a bit more, I totally agree with the decision to use folders rather than pytest.mark
. And I'm digging the fast unit tests :)
Start reorganising the tests into more directories. The major divisions introduced are:
unit
for tests which at most require aMock
modelmodel_integration
for tests which require a 'real' model, but should work with any modelmodel_specific
for isolating issues we've found with particular LLMsneed_credentials
.... exactly what it says. Mainly remote-endpoint tests which don't have full Guidance supportnotebooks
again, exactly what it saysserver
contains tests of the local server. Technicallyunit
tests, but run slowlyThe workflows have been updated to match.