We 've seen those tests on servers (SeldonDeployment CRs) being flaky during the past (e.g. https://github.com/canonical/seldon-core-operator/issues/203), for reasons that we believe are due to resources. Being able to split those and run each server in its own environment will hopefully fix this.
What needs to get done
Configure test_seldon_servers in order to be able to run tests only on one server
When is the task considered done
Once we can trigger tests using tox only on one server.
CI runs each tests for each server on distinct GH runners
Why it needs to get done
We 've seen those tests on servers (SeldonDeployment CRs) being flaky during the past (e.g. https://github.com/canonical/seldon-core-operator/issues/203), for reasons that we believe are due to resources. Being able to split those and run each server in its own environment will hopefully fix this.
What needs to get done
Configure
test_seldon_servers
in order to be able to run tests only on one serverWhen is the task considered done
tox
only on one server.