search

aquarist-labs / aquarium

Project Aquarium is a SUSE-sponsored open source project aiming at becoming an easy to use, rock solid storage appliance based on Ceph.
https://aquarist-labs.io/
Other
71 stars 23 forks source link

gravel: obtaining initial inventory can take too long and blocks bootstrap #328

Closed jecluis closed 3 years ago

jecluis commented 3 years ago

We obtain an initial inventory node upon starting Aquarium. This ought to take about 4-5 seconds on the VM. Yet, sometimes it takes ages, and we block bootstrapping for all that time [1].

This feels a bit like a bug. It may very well be that the controller obtaining the inventory is only doing so after the first tick, instead of running it on the first tick. Or it might be something blocking the first tick from succeeding, and we're obtaining it on the second tick. Or it might actually be taking this long.

We need to figure this out for the benefit of user experience and a speedy bootstrap.

[1] - We need the inventory to automatically infer the IP address we're going to be running on. At a later stage, ideally, to allow the user to select which address to use, etc.

jecluis commented 3 years ago

may or may not be related to https://github.com/aquarist-labs/aquarium/issues/363

jecluis commented 3 years ago

This may have to do with downloading the Ceph containers, hence why sometimes it's really quick and some other times it takes forever to get it going.

jecluis commented 3 years ago

We will always need to block bootstrap while obtaining the inventory for a myriad of reasons (some explained in the original ticket). But the waiting time should be considerably reduced once #464 is merged and we start bundling the containers in the image.