docker / for-mac

Bug reports for Docker Desktop for Mac
https://www.docker.com/products/docker#/mac
2.43k stars 116 forks source link

Latest LinuxKit kernel headers are not published #7267

Open farhadh opened 4 months ago

farhadh commented 4 months ago

Description

The latest LinuxKit kernel headers for kernel 6.6.22 are not available on Docker Hub. The latest one available is 6.6.13. This causes malfunctions in the building of kernel modules against the latest Docker desktop version.

Reproduce

docker pull linuxkit/kernel:6.6.22-build docker pull linuxkit/kernel:6.6.22

Expected behavior

No response

docker version

Client:
 Cloud integration: v1.0.35+desktop.13
 Version:           26.0.0
 API version:       1.45
 Go version:        go1.21.8
 Git commit:        2ae903e
 Built:             Wed Mar 20 15:14:46 2024
 OS/Arch:           darwin/amd64
 Context:           desktop-linux

Server: Docker Desktop 4.29.0 (145265)
 Engine:
  Version:          26.0.0
  API version:      1.45 (minimum version 1.24)
  Go version:       go1.21.8
  Git commit:       8b79278
  Built:            Wed Mar 20 15:18:01 2024
  OS/Arch:          linux/amd64
  Experimental:     false
 containerd:
  Version:          1.6.28
  GitCommit:        ae07eda36dd25f8a1b98dfbf587313b99c0190bb
 runc:
  Version:          1.1.12
  GitCommit:        v1.1.12-0-g51d5e94
 docker-init:
  Version:          0.19.0
  GitCommit:        de40ad0

docker info

Client:
 Version:    26.0.0
 Context:    desktop-linux
 Debug Mode: false
 Plugins:
  buildx: Docker Buildx (Docker Inc.)
    Version:  v0.13.1-desktop.1
    Path:     /Users/farhad/.docker/cli-plugins/docker-buildx
  compose: Docker Compose (Docker Inc.)
    Version:  v2.26.1-desktop.1
    Path:     /Users/farhad/.docker/cli-plugins/docker-compose
  debug: Get a shell into any image or container. (Docker Inc.)
    Version:  0.0.27
    Path:     /Users/farhad/.docker/cli-plugins/docker-debug
  dev: Docker Dev Environments (Docker Inc.)
    Version:  v0.1.2
    Path:     /Users/farhad/.docker/cli-plugins/docker-dev
  extension: Manages Docker extensions (Docker Inc.)
    Version:  v0.2.23
    Path:     /Users/farhad/.docker/cli-plugins/docker-extension
  feedback: Provide feedback, right in your terminal! (Docker Inc.)
    Version:  v1.0.4
    Path:     /Users/farhad/.docker/cli-plugins/docker-feedback
  init: Creates Docker-related starter files for your project (Docker Inc.)
    Version:  v1.1.0
    Path:     /Users/farhad/.docker/cli-plugins/docker-init
  sbom: View the packaged-based Software Bill Of Materials (SBOM) for an image (Anchore Inc.)
    Version:  0.6.0
    Path:     /Users/farhad/.docker/cli-plugins/docker-sbom
  scout: Docker Scout (Docker Inc.)
    Version:  v1.6.3
    Path:     /Users/farhad/.docker/cli-plugins/docker-scout

Server:
 Containers: 25
  Running: 2
  Paused: 0
  Stopped: 23
 Images: 16
 Server Version: 26.0.0
 Storage Driver: overlay2
  Backing Filesystem: extfs
  Supports d_type: true
  Using metacopy: false
  Native Overlay Diff: true
  userxattr: false
 Logging Driver: json-file
 Cgroup Driver: cgroupfs
 Cgroup Version: 2
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local splunk syslog
 Swarm: inactive
 Runtimes: io.containerd.runc.v2 runc
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: ae07eda36dd25f8a1b98dfbf587313b99c0190bb
 runc version: v1.1.12-0-g51d5e94
 init version: de40ad0
 Security Options:
  seccomp
   Profile: unconfined
  cgroupns
 Kernel Version: 6.6.22-linuxkit
 Operating System: Docker Desktop
 OSType: linux
 Architecture: x86_64
 CPUs: 8
 Total Memory: 7.657GiB
 Name: docker-desktop
 ID: acaf609e-8dbf-4f38-bc1e-dab679a61196
 Docker Root Dir: /var/lib/docker
 Debug Mode: false
 HTTP Proxy: http.docker.internal:3128
 HTTPS Proxy: http.docker.internal:3128
 No Proxy: hubproxy.docker.internal
 Labels:
  com.docker.desktop.address=unix:///Users/farhad/Library/Containers/com.docker.docker/Data/docker-cli.sock
 Experimental: false
 Insecure Registries:
  hubproxy.docker.internal:5555
  127.0.0.0/8
 Live Restore Enabled: false

Diagnostics ID

881FBC0A-CF13-405A-BBE2-BB8D12B4BB7C/20240430092408

Additional Info

No response

dgageot commented 3 months ago

@farhadh the information about the kernel and the patches applied to it are all in the VM. You can try docker run --privileged --pid=host --rm -it justincormack/nsenter1 /usr/bin/tree /src Is that enough for your use case? Can you give us more details about what you're trying to achieve? Maybe we can make things better

farhadh commented 3 months ago

@dgageot Thanks for your attention. I need the Linux kernel GTP tunneling module in my LinuxVM kernel for which I need the headers to compile its C code.

n-bes commented 3 months ago

Hi, i want to run eBPF & perf tools, they also require headers

docker run --privileged --pid=host --rm -it justincormack/nsenter1 /usr/bin/tree /src
setns:mnt: Invalid argument

Failed

dgageot commented 2 months ago

@n-bes which version of Docker Desktop are you testing it with? It was added only recently.

n-bes commented 2 months ago

Root of the problem is platform type (arm or x64).

➜  ~ docker run --privileged --pid=host --rm -it --platform=linux/amd64 justincormack/nsenter1 /usr/bin/tree /src
setns:mnt: Invalid argument
➜  ~ docker run --privileged --pid=host --rm -it --platform=linux/arm64 justincormack/nsenter1 /usr/bin/tree /src

Unable to find image 'justincormack/nsenter1:latest' locally
latest: Pulling from justincormack/nsenter1
Digest: sha256:e876f694a4cb6ff9e6861197ea3680fe2e3c5ab773a1e37ca1f13171f7f5798e
Status: Downloaded newer image for justincormack/nsenter1:latest
/src
├── kernel-url
├── kernel-version
├── modules
│   ├── LICENSE
│   ├── Makefile
│   ├── fakeowner.c
│   ├── grpcfuse.c
│   ├── rosetta.c
│   ├── selfowner.c
│   ├── shiftfs.c
│   └── trace_fakeowner.h
└── patches
    ├── 0001-Disable-default_permission-in-virtio_fs.c.patch
    ├── 0002-Revert-Merge-branch-for-next-feat_s1pie-into-for-nex.patch
    ├── 0003-Support-multiple-interpreters.patch
    ├── 0004-Support-openat-with-more-000-on-virtiofs.patch
    ├── 0005-prevent-crash-on-macos12-arm64.patch
    ├── 0006-DOCKER-SAUCE-Define-SHIFTFS_MAGIC.patch
    ├── 0007-virtio-net-add-disable_csum-module-param-to-disable-.patch
    ├── 0008-Fix-unhandled-auxillary-vector-type-28-issue-with-ro.patch
    ├── 0009-hardlinks-drop-the-cache-of-the-existing-entry.patch
    ├── 0010-virtiofs-expose-sys-fs-fuse-and-a-subtype-field.patch
    ├── 0011-virtiofs-expose-an-invalidate-entry-field.patch
    ├── 0012-fuse-Add-negative_dentry_timeout-option.patch
    ├── 0013-virtiofs-allow-server-entry_timeout-to-be-overriden-.patch
    ├── 0014-virtiofs-allow-the-attr_timeout-to-be-set-globally.patch
    ├── 0015-virtiofs-never-query-for-STATX_ATIME.patch
    ├── 0016-virtiofs-add-a-no_flush-arg-which-disables-FUSE_FLUS.patch
    ├── 0017-virtiofs-add-ignore_atime.patch
    ├── 0018-virtiofs-add-trace_rpc-argument.patch
    └── 0019-virtiofs-add-keep_cache-mount-option.patch

2 directories, 29 files
➜  ~ docker version
Client:
 Cloud integration: v1.0.35+desktop.13
 Version:           26.1.1
 API version:       1.45
 Go version:        go1.21.9
 Git commit:        4cf5afa
 Built:             Tue Apr 30 11:44:56 2024
 OS/Arch:           darwin/arm64
 Context:           default

Server: Docker Desktop 4.30.0 (149282)
 Engine:
  Version:          26.1.1
  API version:      1.45 (minimum version 1.24)
  Go version:       go1.21.9
  Git commit:       ac2de55
  Built:            Tue Apr 30 11:48:04 2024
  OS/Arch:          linux/arm64
  Experimental:     false
 containerd:
  Version:          1.6.31
  GitCommit:        e377cd56a71523140ca6ae87e30244719194a521
 runc:
  Version:          1.1.12
  GitCommit:        v1.1.12-0-g51d5e94
 docker-init:
  Version:          0.19.0
  GitCommit:        de40ad0
agilebean commented 1 month ago

it would be great to get the linux headers published soon. meanwhile, the version is 6.6.31, as in:

Unable to locate package linux-headers-6.6.31-linuxkit

but the version installed by apt-get install linux-headers-generic is

/lib/modules/5.4.0-187-generic
beaugunderson commented 1 month ago

Would love an update here; I also need the 6.6.31 headers for eBPF.

Edit: Well, 6.6.32 after today's update.

I did figure out you can yoink these right out of the host container:

docker run \
  -v "$(pwd):/app" \
  --privileged \
  --pid=host \
  --rm \
  -it \
  --platform=linux/arm64 \
  justincormack/nsenter1

Then:

$ cd /src
$ cp kheaders.tar.xz /mnt_host/Users/<your username>/wherever