RFE: image cache resource

[dtantsur]

Currently, the operator runs IPA downloader as an init container. This has a few problems:

• It's not trivial to opt out of using it (OpenShift, for instance, does not use IPA downloader)
• Downloading IPA takes time which delays starting Ironic (although IPA is not actually required on start-up)
• It's not possible to cache IPA for longer time or reuse it between separate Ironic deployments.
• Agent download parameters complicate the already large Ironic CRD
• In the future, we may want to provide an ability to also cache or even build instance images

Let us have a new CRD IronicImageCache that will download IPA in an init container and serve it via httpd.

type IronicImageCacheSpec struct {
    // AgentBranch is the branch of IPA to download. The main branch is used by default.
    // +optional
    AgentBranch string `json:"agentBranch,omitempty"`

    // AgentDownloadURL is the base URL from which IPA should be downloaded.
    // The default value should be good for most users.
    // +optional
    AgentDownloadURL string `json:"agentDownloadURL,omitempty"`

    // AgentDownloaderImage is the image to be used at pod initialization to download the IPA ramdisk.
    // +kubebuilder:default=quay.io/metal3-io/ironic-ipa-downloader
    // +optional
    AgentDownloaderImage string `json:"agentDownloaderImage,omitempty"`

        // AgentMinimumModificationTime is the time after which the IPA image must be produced.
        // If not provided, a hardcoded version-specific default is used.
    // +optional
        AgentMinimumModificationTime *metav1.Time `json:"agentMinimumModificationTime,omitempty"`
}

In the initial version, upgrades will rely on AgentMinimumModificationTime. Every release of the operator, we will update both the Ironic image version and this date. This version will be passed down to IPA downloader as an environment variable, causing it to re-run on changes. Users may update this value to force an upgrade.

[Rozzii]

I would like to go into a different direction, I understand the need for caching and that the current ipa-downloader init container approach is cumbersome.

But I think the caching can be done just fine in the K8s's internal OCI registry or in any OCI registry that is used anyhow for by the K8s instance. I would just make the IPA downloader able to handle OCI artifacts.

When it comes to building an IPA image on the fly, that IMO should be a different topic then the caching, IPA is usually built by OpenstackDIB that is using chroot based process to build the image and I am not sure how reliably can we do it in a containerized environment. But in any case I would really like to separate the caching/storing IPA and building IPA topics.

[dtantsur]

But I think the caching can be done just fine in the K8s's internal OCI registry or in any OCI registry that is used anyhow for by the K8s instance. I would just make the IPA downloader able to handle OCI artifacts.

It feels like an effort that is significantly harder than is here. You don't just need to reach IPA downloader to handle OCI images and registries, you also need to teach Ironic how to fetch an IPA image from such a registry.

When it comes to building an IPA image on the fly, that IMO should be a different topic then the caching

Yeah, I'm not suggesting it here.

[Rozzii]

/triage accepted We need a design proposal!!!! I still think OCI registry based caching is the way.

[metal3-io-bot]

Issues go stale after 90d of inactivity. Mark the issue as fresh with /remove-lifecycle stale. Stale issues will close after an additional 30d of inactivity.

If this issue is safe to close now please do so with /close.

/lifecycle stale

[Rozzii]

/remove-lifecycle stale