search

coreos / fedora-coreos-tracker

Issue tracker for Fedora CoreOS
https://fedoraproject.org/coreos/
263 stars 59 forks source link

Publish uncompressed QCOW2 images for OpenStack #869

Open mnaser opened 3 years ago

mnaser commented 3 years ago

Describe the enhancement It would be quite useful to publish uncompressed qcow2 images for OpenStack. This is quite useful when using it inside automation for things like Terraform where it requires an uncompressed file to upload.

By default, the Terraform provider also caches downloads so it shouldn't cause a big hit in additional traffic so long as folks don't disable it.

System details

Additional information N/A

dustymabe commented 3 years ago

Do you know of any open requests for the tooling you're using (terraform I guess), to support pulling compressed images and processing them directly? It kind of seems silly to have to store things uncompressed (another topic is qcow2 internal compression and benefits/negatives there) and pay for that extra storage when it can just be decompressed on the fly when used.

mnaser commented 3 years ago

@dustymabe: I've did some debugging and the OpenStack provider for Terraform does not support this.

https://github.com/terraform-provider-openstack/terraform-provider-openstack

There's no open issues in this case for this, and I'm not really sure how we can decompress on the fly without adding additional dependencies on libraries that would do that.

jlebon commented 3 years ago

Probably worth filing an issue?

Another approach is to write a small service which streams the OpenStack image uncompressed on-demand and then paste the URL to that service to Terraform.

dustymabe commented 3 years ago

Is the problem here that terraform doesn't support compressed images or is the problem that openstack doesn't support uploading compressed images? I guess the problem could be solved in several ways.

dustymabe commented 3 years ago

This section from https://docs.openstack.org/glance/latest/admin/interoperable-image-import.html seems relevant:

Screenshot_2021-06-23 Interoperable Image Import — glance 22 1 0 dev18 documentation

mnaser commented 3 years ago

This section from https://docs.openstack.org/glance/latest/admin/interoperable-image-import.html seems relevant:

Screenshot_2021-06-23 Interoperable Image Import — glance 22 1 0 dev18 documentation

Unfortunately, this is not widely implemented and it also has quite a few issues in production (i.e.: needing shared storage across all API nodes), we have it disabled in our public cloud for example.

danacr commented 7 months ago

would it be possible to add these images? Using decompress on our openstack provider creates an unbootable image. Flatcar already provides this