Recent issues have shown that current tests are not giving us enough resiliency to see if our updates are breaking features.
While due to the current design of pycasso it's not possible to completely single out certain functions, and failures of components like omni-epd might create large failures of many tests, it's better to have more tests to fail than less.
We should have unit tests run on pycasso start to finish with different configurations or different possible errors. We can likely utilise test mode to generate prompts without pinging providers. omni-epd mock mode should help in generating images we can check in the tests.
Testing providers themselves will likely not be possible.
Recent issues have shown that current tests are not giving us enough resiliency to see if our updates are breaking features.
While due to the current design of pycasso it's not possible to completely single out certain functions, and failures of components like omni-epd might create large failures of many tests, it's better to have more tests to fail than less.
We should have unit tests run on pycasso start to finish with different configurations or different possible errors. We can likely utilise test mode to generate prompts without pinging providers. omni-epd mock mode should help in generating images we can check in the tests.
Testing providers themselves will likely not be possible.