search

neoave / mrack

Multicloud use-case based multihost async provisioner for CIs and testing during development
Apache License 2.0
11 stars 14 forks source link

successfully provisioned resources are not freed when other providers fail #129

Closed Tiboris closed 3 years ago

Tiboris commented 3 years ago

e.g.:

2021-07-27T13:53:12     Beaker: Issuing provisioning of 5 host(s)
...
2021-07-27T13:53:12     OpenStack: Issuing provisioning of 6 host(s)
...
2021-07-27T13:53:12     OpenStack: Printing provisioned hosts

2021-07-27T13:53:12     OpenStack: active 63367b46-6e1f-4bf4-87db-a4778169b2d7 bkr-6-10.eagle.test 192.169.150.46 None None

2021-07-27T13:53:12     OpenStack: active fb388637-9bf0-43e4-b563-c9c474f9740c bkr-7-9.eagle.test 192.169.151.247 None None

2021-07-27T13:53:12     OpenStack: active 656988c8-a550-4818-a978-a0a7db2d0672 bkr-8-5.eagle.test 192.169.150.125 None None

2021-07-27T13:53:12     OpenStack: active 0c383fc0-2d4b-4136-a946-5f55dac05cae bkr-9-0.eagle.test 192.169.151.162 None None

2021-07-27T13:53:12     OpenStack: active 33bef762-152a-4851-baf6-862000feffcf osp-fedora-latest.eagle.test 192.169.151.33 None None

2021-07-27T13:53:12     OpenStack: active 09b6c825-1b8c-45f7-be9f-e4c857f7745e osp-win-2019.eagle.test 192.169.151.206 None None

...

2021-07-27T13:53:12     Beaker: All hosts reached provisioning final state (ACTIVE or ERROR)

2021-07-27T13:53:12     Beaker: Provisioning duration: 2:01:54.930595

...

2021-07-27T13:53:12     Beaker: SSH to host '192.169.34.116' timed out after 686.3s

2021-07-27T13:53:12     Beaker: Aborting provisioning due to error.

2021-07-27T13:53:12     Beaker: Error: New

2021-07-27T13:53:12     Beaker: Error: Could not establish ssh connection to host J:5636830 with IP 192.169.34.116

2021-07-27T13:53:12     Beaker: Given the error, will delete hosts

2021-07-27T13:53:12     Beaker: Issuing deletion

2021-07-27T13:53:12     Beaker: Deleting host by cancelling Job J:5636829

2021-07-27T13:53:12     Beaker: Deleting host by cancelling Job J:5636832

2021-07-27T13:53:12     Beaker: Deleting host by cancelling Job J:5636833

2021-07-27T13:53:12     Beaker: Deleting host by cancelling Job J:5636831

2021-07-27T13:53:12     Beaker: Deleting host by cancelling Job J:5636830

2021-07-27T13:53:12     Beaker: All servers issued to be deleted

2021-07-27T13:53:12     [<mrack.host.Host object at 0x7f1ebd50e790>, <mrack.host.Host object at 0x7f1ebd50ed90>]

echo $?

1