nestybox / sysbox

An open-source, next-generation "runc" that empowers rootless containers to run workloads such as Systemd, Docker, Kubernetes, just like VMs.
Apache License 2.0
2.78k stars 152 forks source link

Sysbox and kindest/node image incompatibility issue with latest v1.2x images #301

Closed rodnymolina closed 3 years ago

rodnymolina commented 3 years ago

Due to the latest changes in Kind's docker-images entrypoints, Sysbox is not able to launch Kind's images, nor able to wrap Kind's images with our own Sysbox images as we have been doing since day one.

Kind's latest entrypoint modifications condition the support of user-namespaces to the activation of cgroup-v2 in the system. This approach conflicts with Sysbox as user-namespaces feature is always supported regardless of the cgroup configuration of the system. Aside from that, Sysbox doesn't support cgroup-v2 (yet), so currently we can't meet this requirement imposed by Kind.

For the time being we will continue to provide 'kindest/node' images as thin wrappers over Kind's ones. In the future, once all the above issues are solved, Sysbox users should be able to make direct use of Kind images -- although technically speaking that will always depend on the restrictions/assumptions imposed by Kind's images entrypoint.

In the meantime, till we generate the new kindest/node images for v1.20 and v1.21 (which are the ones impacted by this issue), we suggest to continue utilizing the existing nestybox/kindest/node:v1.18 and nestybox/kindest/node:v1.19 images.

ctalledo commented 3 years ago

Note: even after we add support for cgroups v2 to Sysbox (soon), using cgroups v2 requires a machine whose kernel was booted with cgroups v2. I know Fedora has made the transition to enabling cgroups v2 by default, but not sure if Ubuntu has done the same. If not enable by default, it can be easily enabled via GRUB and rebooting the host, but it's an extra step.

ctalledo commented 3 years ago

Sysbox v0.4.0 supports cgroups v2, so it's possible to run the latest versions of kind inside a Sysbox container.

Closing.