search

kata-containers / tests

Kata Containers tests, CI, and metrics
https://katacontainers.io/
Apache License 2.0
139 stars 196 forks source link

tests: nydus: Skip tests when using dragonball #5771

Open fidencio opened 1 year ago

fidencio commented 1 year ago

When updating nydus to 2.2.3 and nydus-snapshotter to 0.12.0, some work will be needed on dragonball side as the nydus tests are failing there with the following error:

09:55:09 INFO: Running nydus test
09:55:09 bash -f integration/nydus/nydus_tests.sh
09:55:09 Running setup
09:55:09 Download tarball from https://github.com/dragonflyoss/image-service/releases/download/v2.2.3/nydus-static-v2.2.3-linux-amd64.tgz
09:55:10 Download tarball from https://github.com/containerd/nydus-snapshotter/releases/download/v0.12.0/nydus-snapshotter-v0.12.0-x86_64.tgz
09:55:11 Enabling all debug options in file /etc/kata-containers/configuration.toml
09:55:11 [debug]
09:55:11   level = "debug"
09:55:11 [proxy_plugins]
09:55:11   [proxy_plugins.nydus]
09:55:11     type = "snapshot"
09:55:11     address = "/run/containerd-nydus/containerd-nydus-grpc.sock"
09:55:11 [plugins]
09:55:11   [plugins.cri]
09:55:11     disable_hugetlb_controller = false
09:55:11     [plugins.cri.containerd]
09:55:11       snapshotter = "nydus"
09:55:11       disable_snapshot_annotations = false
09:55:11       [plugins.cri.containerd.runtimes]
09:55:11       [plugins.cri.containerd.runtimes.runc]
09:55:11          runtime_type = "io.containerd.runc.v2"
09:55:11          [plugins.cri.containerd.runtimes.runc.options]
09:55:11            BinaryName = "/usr/local/sbin/runc"
09:55:11            Root = ""
09:55:11       [plugins.cri.containerd.runtimes.kata]
09:55:11          runtime_type = "io.containerd.kata.v2"
09:55:11          privileged_without_host_devices = true
09:55:11 INFO: restart containerd service
09:55:12 nydus-snapshotter is running
09:55:12 Running nydus integration tests
09:55:13 Image is up to date for sha256:dcac4621b8636ac822ab7737648a272fcf378b8df6d315816036f00d5536d1e2
09:55:15 Pod 47232412d47a6af55dff6659a287aef9e625ba417f6aa690b96254c3dac4ec18 created
09:55:16 Container 95760e7e3b072e4c47b9c78753d18590b6ede8887a6bd438885c1c9762933c67 created
09:55:16 time="2023-09-18T07:55:16Z" level=fatal msg="starting the container \"95760e7e3b072e4c47b9c78753d18590b6ede8887a6bd438885c1c9762933c67\": rpc error: code = Unknown desc = failed to create containerd task: failed to create shim task: Others(\"failed to handler message create container\\n\\nCaused by:\\n    0: create\\n    1: handler rootfs\\n    2: new nydus rootfs\\n    3: failed to do rafs mount\\n    4: fail to attach rafs \\\"/var/lib/containerd-nydus/snapshots/2/fs/image/image.boot\\\"\\n    5: add share fs mount\\n    6: Mount rafs at /rafs/95760e7e3b072e4c47b9c78753d18590b6ede8887a6bd438885c1c9762933c67/rootfs_lower error: Failed to Mount backend Some(\\\"rafs\\\") at /rafs/95760e7e3b072e4c47b9c78753d18590b6ede8887a6bd438885c1c9762933c67/rootfs_lower mount config FsMountConfigInfo { ops: \\\"mount\\\", fstype: Some(\\\"rafs\\\"), source: Some(\\\"/var/lib/containerd-nydus/snapshots/2/fs/image/image.boot\\\"), mountpoint: \\\"/rafs/95760e7e3b072e4c47b9c78753d18590b6ede8887a6bd438885c1c9762933c67/rootfs_lower\\\", config: Some(\\\"{\\\\\\\"device\\\\\\\":{\\\\\\\"backend\\\\\\\":{\\\\\\\"type\\\\\\\":\\\\\\\"registry\\\\\\\",\\\\\\\"config\\\\\\\":{\\\\\\\"readahead\\\\\\\":false,\\\\\\\"host\\\\\\\":\\\\\\\"ghcr.io\\\\\\\",\\\\\\\"repo\\\\\\\":\\\\\\\"dragonflyoss/image-service/alpine\\\\\\\",\\\\\\\"proxy\\\\\\\":{\\\\\\\"fallback\\\\\\\":false},\\\\\\\"timeout\\\\\\\":5,\\\\\\\"connect_timeout\\\\\\\":5,\\\\\\\"retry_limit\\\\\\\":2}},\\\\\\\"cache\\\\\\\":{\\\\\\\"type\\\\\\\":\\\\\\\"blobcache\\\\\\\",\\\\\\\"config\\\\\\\":{\\\\\\\"work_dir\\\\\\\":\\\\\\\"/var/lib/containerd-nydus/cache\\\\\\\",\\\\\\\"disable_indexed_map\\\\\\\":false}}},\\\\\\\"mode\\\\\\\":\\\\\\\"direct\\\\\\\",\\\\\\\"digest_validate\\\\\\\":false,\\\\\\\"enable_xattr\\\\\\\":true,\\\\\\\"fs_prefetch\\\\\\\":{\\\\\\\"enable\\\\\\\":true,\\\\\\\"prefetch_all\\\\\\\":true,\\\\\\\"threads_count\\\\\\\":8,\\\\\\\"merging_size\\\\\\\":1048576,\\\\\\\"bandwidth_rate\\\\\\\":0}}\\\"), tag: \\\"kataShared\\\", prefetch_list_path: None, dax_threshold_size_kb: None }\\n       \\n       Caused by:\\n           vmm action error: FsDevice(AttachBackendFailed(\\\"attach/detach a backend filesystem failed:: missing field `version` at line 1 column 489\\\"))\"): unknown"
09:55:16 [nydus_tests.sh:164] ERROR: sudo -E crictl start 95760e7e3b072e4c47b9c78753d18590b6ede8887a6bd438885c1c9762933c67
09:55:16 Running teardown
09:55:16 integration/nydus/nydus_tests.sh: line 189: 29579 Killed                  nohup /usr/local/bin/containerd-nydus-grpc --config /etc/snapshotter-config.toml --nydusd-config /etc/nydusd-config.json --log-to-stdout > /dev/null 2>&1

/cc @studychao @ChengyuZhu6

stevenhorsman commented 1 year ago

When we get this resolved and re-enable the test we'll need to be aware to remove the skip in kata-containers tests (introduced in https://github.com/kata-containers/kata-containers/pull/7961/commits/aea39f8fddd2604d5b712e880979304c05b255fa) as well