openstack-charmers / zaza-openstack-tests

OpenStack Charms Functional Test Library for Zaza
Apache License 2.0
7 stars 77 forks source link

zaza.openstack.charm_tests.neutron.tests.NeutronNetworkingTest may in some circumstances not perform a valid test #641

Open fnordahl opened 3 years ago

fnordahl commented 3 years ago

The premise of the NeutronNetworkingTest is to validate end to end connectivity between two instances on two separate hypervisors. We do this by having a bundle with at least two hypervisors and requesting two instances from Nova.

Nova scheduling will in most cases place the two instances on separate hypervisors, but it does not always do that. And in the cases when both instances end up on the same hypervisor the test may provide a false positive result.

The Nova API does expose mechanisms for an administrator to request specific placement of instances, and I think it would be worth to use those and assert diverse placement of instances prior to assessing connectivity.

fnordahl commented 2 years ago

The CI test runner does not have administrator credentials to the CI cloud. So the initial thought of using specific host placement will not be practical.

An alternative could be to explore the Nova server groups API