coreos / fedora-coreos-tracker

Issue tracker for Fedora CoreOS
https://fedoraproject.org/coreos/
262 stars 59 forks source link

Kubernetes v1.24+ container runtime on Fedora CoreOS #767

Open dghubble opened 3 years ago

dghubble commented 3 years ago

Kubernetes intends to drop drop support for docker-shim as a container runtime in v1.22. Currently, Fedora CoreOS 33.20210217.3.0 ships docker 19.03.13. docker-shim remains the most stable, tested, available out-of-the-box runtime, but this will end soon. I'd like some kind of clarity on Fedora CoreOS's intentions, such as shipping a compatible containerd or cri-o. With Kubernetes cutting v1.22 alpha releases (likely pretty soon) in the time frame of Fedora 34, as Kubernetes distros we'll want to start evaluating and conformance testing the selection.

Overall, I'd like to know there is some plan. Ideally a documented one. Flatcar Linux has published their intentions to ship containerd in time and already has a mechanism to test it (docs).

cri-o

It sounds like cri-o can only be installed by downloading an RPM (from where?) directly and rpm-ostree installing it (unverified). dnf and yumdownloader used by an openshift script aren't present. https://github.com/coreos/fedora-coreos-tracker/issues/292#issuecomment-796998069. I have some maturity concerns about that. Is this really the recommended path? For a container optimized distro to not have a better path to getting a container runtime?

Releases are also pinned to Kubernetes versions and seem to lag by quite some time, so I have some velocity concerns (the runtime needs to be fairly stable, we roll forward when Kubernetes does, think hours).

containerd

I haven't seen Fedora CoreOS plans to make this the runtime of choice.

Or is the plan something else?

buckaroogeek commented 2 years ago

Also on matrix as buckaroogeek. Fedora-coresos and fedora-arm mostly

On Thu, Jan 13, 2022, 05:34 Anthony Rabbito @.***> wrote:

I do not want to further side track this issue. May I contact you directly?

@buckaroogeek https://github.com/buckaroogeek @anthr76 https://github.com/anthr76 what channel do you prefer? IRC, email, ...?

I'm on matrix as @anthr76 https://github.com/anthr76:mozilla.org I'm in

fedora-coreos and #fedora-golang which is also bridged with IRC

— Reply to this email directly, view it on GitHub https://github.com/coreos/fedora-coreos-tracker/issues/767#issuecomment-1012141009, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAKDYHXXXO4OWXZUJD2RHBTUV3IERANCNFSM4ZBN6ONA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

You are receiving this because you were mentioned.Message ID: @.***>

Conan-Kudo commented 2 years ago

@ingvagabund @anthr76 Please file a request for sponsoring @anthr76 through to co-maintain kubernetes here: https://pagure.io/packager-sponsors

cgwalters commented 2 years ago

I think this one is going to intersect with https://github.com/coreos/enhancements/blob/main/os/coreos-layering.md for many people.

dustymabe commented 1 year ago

From @jlebon's memory (which is much better than my memory) in the video community meeting today he think's the remaining steps here are:

buckaroogeek commented 1 year ago

Please let me know how I can help. At one point, Anthony (@anthr76) and I were considering modules for kubernetes, but the approach taken by the nodejs and haskell maintainers on multiple versions seems to be more approachable. I have been negligent in getting a change request submitted to outline the path forward.

The version of go supported in a given Fedora release would shape the version(s) of kubernetes available from Fedora repositories. For example, F37 has go 1.19.x. Kubernetes 1.25, 1.24, and 1.23 would be available allowing Fedora, including CoreOS, to function as a node for any supported version of Kubernetes and as a workstation hosting kubectl to manage those clusters.

Regardless of the approach, I would like to see (and help produce) good documentation for end users around the installation of vanilla kubernetes on all suitable variants of Fedora.