search

moby / buildkit

concurrent, cache-efficient, and Dockerfile-agnostic builder toolkit
https://github.com/moby/moby/issues/34227
Apache License 2.0
7.83k stars 1.09k forks source link

Flaky test: `TestClientGatewayContainerHostNetworkingValidation` #5087

Open crazy-max opened 6 days ago

crazy-max commented 6 days ago

https://github.com/moby/buildkit/actions/runs/9661415068/job/26649244979?pr=4989#step:8:1673

saw it in https://github.com/moby/buildkit/pull/4989

=== FAIL: client TestClientGatewayIntegration/TestClientGatewayContainerHostNetworkingValidation/worker=containerd-1.6/netmode=host (1.27s)
    build_test.go:2133: 
            Error Trace:    /src/client/build_test.go:2133
                                        /src/client/build_test.go:2031
                                        /src/util/testutil/integration/run.go:96
                                        /src/util/testutil/integration/run.go:211
            Error:          Received unexpected error:
                            expecting started message, got *moby_buildkit_v1_frontend.ExecMessage_Exit
                            github.com/moby/buildkit/util/stack.Enable
                                /src/util/stack/stack.go:78
                            github.com/moby/buildkit/util/grpcerrors.FromGRPC
                                /src/util/grpcerrors/grpcerrors.go:198
                            github.com/moby/buildkit/util/grpcerrors.UnaryClientInterceptor
                                /src/util/grpcerrors/intercept.go:41
                            google.golang.org/grpc.(*ClientConn).Invoke
                                /src/vendor/google.golang.org/grpc/call.go:35
                            github.com/moby/buildkit/api/services/control.(*controlClient).Solve
                                /src/api/services/control/control.pb.go:2234
                            github.com/moby/buildkit/client.(*Client).solve.func2
                                /src/client/solve.go:270
                            golang.org/x/sync/errgroup.(*Group).Go.func1
                                /src/vendor/golang.org/x/sync/errgroup/errgroup.go:75
                            runtime.goexit
                                /usr/local/go/src/runtime/asm_amd64.s:1695
                            failed to solve
                            github.com/moby/buildkit/client.(*Client).solve.func2
                                /src/client/solve.go:286
                            golang.org/x/sync/errgroup.(*Group).Go.func1
                                /src/vendor/golang.org/x/sync/errgroup/errgroup.go:75
                            runtime.goexit
                                /usr/local/go/src/runtime/asm_amd64.s:1695
            Test:           TestClientGatewayIntegration/TestClientGatewayContainerHostNetworkingValidation/worker=containerd-1.6/netmode=host
    sandbox.go:133: stderr: /opt/containerd-alt-16/bin/containerd --config /tmp/bktest_containerd2544901996/config.toml
    sandbox.go:136: > StartCmd 2024-06-25 11:22:03.564943675 +0000 UTC m=+0.671333328 /opt/containerd-alt-16/bin/containerd --config /tmp/bktest_containerd2544901996/config.toml
    sandbox.go:136: time="2024-06-25T11:22:03Z" level=warning msg="containerd config version `1` has been deprecated and will be converted on each startup in containerd v2.0, use `containerd config migrate` after upgrading to containerd 2.0 to avoid conversion on startup"
    sandbox.go:136: time="2024-06-25T11:22:03.617617144Z" level=info msg="starting containerd" revision=d2d58213f83a351ca8f528a95fbd145f5654e957 version=v1.6.33
    sandbox.go:136: time="2024-06-25T11:22:03.648019125Z" level=info msg="loading plugin \"io.containerd.content.v1.content\"..." type=io.containerd.content.v1
    sandbox.go:136: time="2024-06-25T11:22:03.648251141Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.devmapper\"..." type=io.containerd.snapshotter.v1
    sandbox.go:136: time="2024-06-25T11:22:03.648287409Z" level=warning msg="failed to load plugin io.containerd.snapshotter.v1.devmapper" error="devmapper not configured"
    sandbox.go:136: time="2024-06-25T11:22:03.648309510Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.native\"..." type=io.containerd.snapshotter.v1
    sandbox.go:136: time="2024-06-25T11:22:03.648431469Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.overlayfs\"..." type=io.containerd.snapshotter.v1
    sandbox.go:136: time="2024-06-25T11:22:03.648777589Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.aufs\"..." type=io.containerd.snapshotter.v1
    sandbox.go:136: time="2024-06-25T11:22:03.657394676Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.aufs\"..." error="aufs is not supported (modprobe aufs failed: exit status 1 \"modprobe: can't change directory to '/lib/modules': No such file or directory\\n\"): skip plugin" type=io.containerd.snapshotter.v1
    sandbox.go:136: time="2024-06-25T11:22:03.657466711Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.zfs\"..." type=io.containerd.snapshotter.v1
    sandbox.go:136: time="2024-06-25T11:22:03.657720608Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.zfs\"..." error="path /tmp/bktest_containerd2544901996/root/io.containerd.snapshotter.v1.zfs must be a zfs filesystem to be used with the zfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1
    sandbox.go:136: time="2024-06-25T11:22:03.657749422Z" level=info msg="loading plugin \"io.containerd.metadata.v1.bolt\"..." type=io.containerd.metadata.v1
    sandbox.go:136: time="2024-06-25T11:22:03.657847246Z" level=warning msg="could not use snapshotter devmapper in metadata plugin" error="devmapper not configured"
    sandbox.go:136: time="2024-06-25T11:22:03.657865901Z" level=info msg="metadata content store policy set" policy=shared
    sandbox.go:136: time="2024-06-25T11:22:03.661062445Z" level=info msg="loading plugin \"io.containerd.differ.v1.walking\"..." type=io.containerd.differ.v1
    sandbox.go:136: time="2024-06-25T11:22:03.661098804Z" level=info msg="loading plugin \"io.containerd.event.v1.exchange\"..." type=io.containerd.event.v1
    sandbox.go:136: time="2024-06-25T11:22:03.661117379Z" level=info msg="loading plugin \"io.containerd.gc.v1.scheduler\"..." type=io.containerd.gc.v1
    sandbox.go:136: time="2024-06-25T11:22:03.661163996Z" level=info msg="loading plugin \"io.containerd.runtime.v1.linux\"..." type=io.containerd.runtime.v1
    sandbox.go:136: time="2024-06-25T11:22:03.661367990Z" level=info msg="loading plugin \"io.containerd.runtime.v2.task\"..." type=io.containerd.runtime.v2
    sandbox.go:136: time="2024-06-25T11:22:03.661522329Z" level=info msg="loading plugin \"io.containerd.internal.v1.opt\"..." type=io.containerd.internal.v1
    sandbox.go:136: time="2024-06-25T11:22:03.661859513Z" level=info msg="loading plugin \"io.containerd.warning.v1.deprecations\"..." type=io.containerd.warning.v1
    sandbox.go:136: time="2024-06-25T11:22:03.661880903Z" level=info msg="loading plugin \"io.containerd.monitor.v1.cgroups\"..." type=io.containerd.monitor.v1
    sandbox.go:136: time="2024-06-25T11:22:03.663573622Z" level=info msg="loading plugin \"io.containerd.service.v1.containers-service\"..." type=io.containerd.service.v1
    sandbox.go:136: time="2024-06-25T11:22:03.663597086Z" level=info msg="loading plugin \"io.containerd.service.v1.content-service\"..." type=io.containerd.service.v1
    sandbox.go:136: time="2024-06-25T11:22:03.663614289Z" level=info msg="loading plugin \"io.containerd.service.v1.diff-service\"..." type=io.containerd.service.v1
    sandbox.go:136: time="2024-06-25T11:22:03.663629618Z" level=info msg="loading plugin \"io.containerd.service.v1.images-service\"..." type=io.containerd.service.v1
    sandbox.go:136: time="2024-06-25T11:22:03.663646009Z" level=info msg="loading plugin \"io.containerd.service.v1.introspection-service\"..." type=io.containerd.service.v1
    sandbox.go:136: time="2024-06-25T11:22:03.663660886Z" level=info msg="loading plugin \"io.containerd.service.v1.leases-service\"..." type=io.containerd.service.v1
    sandbox.go:136: time="2024-06-25T11:22:03.663676005Z" level=info msg="loading plugin \"io.containerd.service.v1.namespaces-service\"..." type=io.containerd.service.v1
    sandbox.go:136: time="2024-06-25T11:22:03.663691484Z" level=info msg="loading plugin \"io.containerd.service.v1.snapshots-service\"..." type=io.containerd.service.v1
    sandbox.go:136: time="2024-06-25T11:22:03.663706502Z" level=info msg="loading plugin \"io.containerd.service.v1.tasks-service\"..." type=io.containerd.service.v1
    sandbox.go:136: time="2024-06-25T11:22:03.663730026Z" level=debug msg="No RDT config file specified, RDT not configured"
    sandbox.go:136: time="2024-06-25T11:22:03.663743211Z" level=info msg="loading plugin \"io.containerd.grpc.v1.containers\"..." type=io.containerd.grpc.v1
    sandbox.go:136: time="2024-06-25T11:22:03.663758410Z" level=info msg="loading plugin \"io.containerd.grpc.v1.content\"..." type=io.containerd.grpc.v1
    sandbox.go:136: time="2024-06-25T11:22:03.663773618Z" level=info msg="loading plugin \"io.containerd.grpc.v1.diff\"..." type=io.containerd.grpc.v1
    sandbox.go:136: time="2024-06-25T11:22:03.663788807Z" level=info msg="loading plugin \"io.containerd.grpc.v1.events\"..." type=io.containerd.grpc.v1
    sandbox.go:136: time="2024-06-25T11:22:03.663802783Z" level=info msg="loading plugin \"io.containerd.grpc.v1.images\"..." type=io.containerd.grpc.v1
    sandbox.go:136: time="2024-06-25T11:22:03.663818963Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1
    sandbox.go:136: time="2024-06-25T11:22:03.663832649Z" level=info msg="loading plugin \"io.containerd.grpc.v1.leases\"..." type=io.containerd.grpc.v1
    sandbox.go:136: time="2024-06-25T11:22:03.663848218Z" level=info msg="loading plugin \"io.containerd.grpc.v1.namespaces\"..." type=io.containerd.grpc.v1
    sandbox.go:136: time="2024-06-25T11:22:03.663863337Z" level=info msg="loading plugin \"io.containerd.grpc.v1.snapshots\"..." type=io.containerd.grpc.v1
+ ecode=1
+ go tool covdata textfmt '-i=/testreports/helpers' '-o=/testreports/helpers-report.txt'
    sandbox.go:136: time="2024-06-25T11:22:03.663879768Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1
    sandbox.go:136: time="2024-06-25T11:22:03.663903342Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1
    sandbox.go:136: time="2024-06-25T11:22:03.663918711Z" level=info msg="loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." type=io.containerd.tracing.processor.v1
    sandbox.go:136: time="2024-06-25T11:22:03.663937085Z" level=info msg="skip loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." error="skip plugin: tracing endpoint not configured" type=io.containerd.tracing.processor.v1
    sandbox.go:136: time="2024-06-25T11:22:03.663948867Z" level=info msg="loading plugin \"io.containerd.internal.v1.tracing\"..." type=io.containerd.internal.v1
    sandbox.go:136: time="2024-06-25T11:22:03.663966471Z" level=info msg="skip loading plugin \"io.containerd.internal.v1.tracing\"..." error="skip plugin: tracing endpoint not configured" type=io.containerd.internal.v1
    sandbox.go:136: time="2024-06-25T11:22:03.664003520Z" level=info msg="loading plugin \"io.containerd.internal.v1.restart\"..." type=io.containerd.internal.v1
    sandbox.go:136: time="2024-06-25T11:22:03.664050598Z" level=info msg="loading plugin \"io.containerd.grpc.v1.healthcheck\"..." type=io.containerd.grpc.v1
    sandbox.go:136: time="2024-06-25T11:22:03.664259992Z" level=info msg=serving... address=/tmp/bktest_containerd2544901996/debug.sock
    sandbox.go:136: time="2024-06-25T11:22:03.664327038Z" level=info msg=serving... address=/tmp/bktest_containerd2544901996/containerd.sock.ttrpc
    sandbox.go:136: time="2024-06-25T11:22:03.664383614Z" level=info msg=serving... address=/tmp/bktest_containerd2544901996/containerd.sock
    sandbox.go:136: time="2024-06-25T11:22:03.664400095Z" level=debug msg="sd notification" error="<nil>" notified=false state="READY=1"
    sandbox.go:136: time="2024-06-25T11:22:03.664412258Z" level=info msg="containerd successfully booted in 0.049998s"
    sandbox.go:136: time="2024-06-25T11:22:04.109490346Z" level=debug msg="(*service).Write started" expected="sha256:023917ec6a886d0e8e15f28fb543515a5fcd8d938edb091e8147db4efed388ee" ref="manifest-sha256:023917ec6a886d0e8e15f28fb543515a5fcd8d938edb091e8147db4efed388ee" total=528
    sandbox.go:136: time="2024-06-25T11:22:04.153352829Z" level=debug msg="(*service).Write started" expected="sha256:a416a98b71e224a31ee99cff8e16063554498227d2b696152a9c3e0aa65e5824" ref="config-sha256:a416a98b71e224a31ee99cff8e16063554498227d2b696152a9c3e0aa65e5824" total=1457
    sandbox.go:136: time="2024-06-25T11:22:04.219913577Z" level=debug msg="stat snapshot" key="sha256:3d24ee258efc3bfe4066a1a9fb83febf6dc0b1548dfe896161533668281c9f4f"
    sandbox.go:136: time="2024-06-25T11:22:04.230071999Z" level=debug msg="(*service).Write started" expected="sha256:3f4d90098f5b5a6f6a76e9d217da85aa39b2081e30fa1f7d287138d6e7bf0ad7" ref="layer-sha256:3f4d90098f5b5a6f6a76e9d217da85aa39b2081e30fa1f7d287138d6e7bf0ad7" total=2219949
    sandbox.go:136: time="2024-06-25T11:22:04.311489564Z" level=debug msg="prepare snapshot" key="extract-4pahozescz5e5pky54fwzfz12 sha256:3d24ee258efc3bfe4066a1a9fb83febf6dc0b1548dfe896161533668281c9f4f" parent=
    sandbox.go:136: time="2024-06-25T11:22:04.323120221Z" level=debug msg="get snapshot mounts" key="extract-4pahozescz5e5pky54fwzfz12 sha256:3d24ee258efc3bfe4066a1a9fb83febf6dc0b1548dfe896161533668281c9f4f"
    sandbox.go:136: time="2024-06-25T11:22:04.324038376Z" level=debug msg="unpigz not found, falling back to go gzip" error="exec: \"unpigz\": executable file not found in $PATH"
    sandbox.go:136: time="2024-06-25T11:22:04.615749533Z" level=debug msg="diff applied" d=291.991985ms digest="sha256:3f4d90098f5b5a6f6a76e9d217da85aa39b2081e30fa1f7d287138d6e7bf0ad7" media=application/vnd.docker.image.rootfs.diff.tar.gzip size=2219949
    sandbox.go:136: time="2024-06-25T11:22:04.616255208Z" level=debug msg="stat snapshot" key="extract-4pahozescz5e5pky54fwzfz12 sha256:3d24ee258efc3bfe4066a1a9fb83febf6dc0b1548dfe896161533668281c9f4f"
    sandbox.go:136: time="2024-06-25T11:22:04.616801383Z" level=debug msg="commit snapshot" key="extract-4pahozescz5e5pky54fwzfz12 sha256:3d24ee258efc3bfe4066a1a9fb83febf6dc0b1548dfe896161533668281c9f4f" name="sha256:3d24ee258efc3bfe4066a1a9fb83febf6dc0b1548dfe896161533668281c9f4f"
    sandbox.go:136: time="2024-06-25T11:22:04.637898407Z" level=debug msg="prepare snapshot" key=teult5g0o9z9gsw1o8vcezo1w parent="sha256:3d24ee258efc3bfe4066a1a9fb83febf6dc0b1548dfe896161533668281c9f4f"
    sandbox.go:136: time="2024-06-25T11:22:04.660064104Z" level=debug msg="(*service).Write started" ref=history-ref_658665717-HuOL
    sandbox.go:133: stdout: /usr/bin/buildkitd --containerd-worker-gc=false --containerd-worker=true --containerd-worker-addr /tmp/bktest_containerd2544901996/containerd.sock --containerd-worker-labels=org.mobyproject.buildkit.worker.sandbox=true --oci-worker=false --config=/tmp/bktest_config2611257305/buildkitd.toml --root /tmp/bktest_buildkitd4257723819 --addr unix:///tmp/bktest_buildkitd4257723819/buildkitd.sock --debug
    sandbox.go:133: stderr: /usr/bin/buildkitd --containerd-worker-gc=false --containerd-worker=true --containerd-worker-addr /tmp/bktest_containerd2544901996/containerd.sock --containerd-worker-labels=org.mobyproject.buildkit.worker.sandbox=true --oci-worker=false --config=/tmp/bktest_config2611257305/buildkitd.toml --root /tmp/bktest_buildkitd4257723819 --addr unix:///tmp/bktest_buildkitd4257723819/buildkitd.sock --debug
    sandbox.go:136: > StartCmd 2024-06-25 11:22:03.679110018 +0000 UTC m=+0.785499701 /usr/bin/buildkitd --containerd-worker-gc=false --containerd-worker=true --containerd-worker-addr /tmp/bktest_containerd2544901996/containerd.sock --containerd-worker-labels=org.mobyproject.buildkit.worker.sandbox=true --oci-worker=false --config=/tmp/bktest_config2611257305/buildkitd.toml --root /tmp/bktest_buildkitd4257723819 --addr unix:///tmp/bktest_buildkitd4257723819/buildkitd.sock --debug
    sandbox.go:136: time="2024-06-25T11:22:03Z" level=warning msg="failed to get disk size: no such file or directory"
    sandbox.go:136: time="2024-06-25T11:22:03Z" level=warning msg="failed to get disk size: no such file or directory"
    sandbox.go:136: time="2024-06-25T11:22:03Z" level=debug msg="could not read \"/tmp/bktest_buildkitd4257723819/net/cni\" for cleanup: open /tmp/bktest_buildkitd4257723819/net/cni: no such file or directory"
    sandbox.go:136: time="2024-06-25T11:22:03Z" level=debug msg="creating new network namespace 8xrjqt2zn2woauhescsorfxr3"
    sandbox.go:136: time="2024-06-25T11:22:03Z" level=debug msg="finished creating network namespace 8xrjqt2zn2woauhescsorfxr3"
    sandbox.go:136: time="2024-06-25T11:22:03Z" level=debug msg="finished setting up network namespace 8xrjqt2zn2woauhescsorfxr3"
    sandbox.go:136: time="2024-06-25T11:22:03Z" level=debug msg="remote introspection plugin filters" filters="[type==io.containerd.runtime.v1 type==io.containerd.runtime.v2]"
    sandbox.go:136: time="2024-06-25T11:22:03Z" level=info msg="found worker \"zboei0p0ihz08c0lr0427bkok\", labels=map[org.mobyproject.buildkit.worker.containerd.namespace:buildkit org.mobyproject.buildkit.worker.containerd.uuid:b7903f3e-e9a9-4bc1-8196-9dd70c9a04b4 org.mobyproject.buildkit.worker.executor:containerd org.mobyproject.buildkit.worker.hostname:e684319991d7 org.mobyproject.buildkit.worker.network:cni org.mobyproject.buildkit.worker.sandbox:true org.mobyproject.buildkit.worker.selinux.enabled:false org.mobyproject.buildkit.worker.snapshotter:overlayfs], platforms=[linux/amd64 linux/amd64/v2 linux/amd64/v3 linux/arm64 linux/riscv64 linux/ppc64le linux/s390x linux/386 linux/mips64le linux/mips64 linux/arm/v7 linux/arm/v6]"
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=info msg="found 1 workers, default=\"zboei0p0ihz08c0lr0427bkok\""
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=warning msg="currently, only the default worker can be used."
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=info msg="running server on /tmp/bktest_buildkitd4257723819/buildkitd.sock"
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=debug msg="session started"
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=debug msg="|<--- NewContainer m4joxgrtkojxm10jp0mfekkoj"
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=debug msg="checked for cached auth handler namespace" cached=false key="docker.io/library/busybox::pull" name=docker.io/library/busybox scope=pull
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=debug msg=resolving host="localhost:46105"
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=debug msg="do request" host="localhost:46105" request.header.accept="application/vnd.docker.distribution.manifest.v2+json, application/vnd.docker.distribution.manifest.list.v2+json, application/vnd.oci.image.manifest.v1+json, application/vnd.oci.image.index.v1+json, */*" request.header.user-agent=buildkit/v0.0.0+unknown request.method=HEAD url="http://localhost:46105/v2/library/busybox/manifests/latest?ns=docker.io"
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=debug msg="fetch response received" host="localhost:46105" response.header.content-length=528 response.header.content-type=application/vnd.docker.distribution.manifest.v2+json response.header.date="Tue, 25 Jun 2024 11:22:04 GMT" response.header.docker-content-digest="sha256:023917ec6a886d0e8e15f28fb543515a5fcd8d938edb091e8147db4efed388ee" response.header.docker-distribution-api-version=registry/2.0 response.header.etag="\"sha256:023917ec6a886d0e8e15f28fb543515a5fcd8d938edb091e8147db4efed388ee\"" response.status="200 OK" url="http://localhost:46105/v2/library/busybox/manifests/latest?ns=docker.io"
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=debug msg=resolved desc.digest="sha256:023917ec6a886d0e8e15f28fb543515a5fcd8d938edb091e8147db4efed388ee" host="localhost:46105"
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=debug msg=fetch digest="sha256:023917ec6a886d0e8e15f28fb543515a5fcd8d938edb091e8147db4efed388ee" mediatype=application/vnd.docker.distribution.manifest.v2+json size=528
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=debug msg="do request" digest="sha256:023917ec6a886d0e8e15f28fb543515a5fcd8d938edb091e8147db4efed388ee" mediatype=application/vnd.docker.distribution.manifest.v2+json request.header.accept="application/vnd.docker.distribution.manifest.v2+json, */*" request.header.user-agent=buildkit/v0.0.0+unknown request.method=GET size=528 url="http://localhost:46105/v2/library/busybox/manifests/sha256:023917ec6a886d0e8e15f28fb543515a5fcd8d938edb091e8147db4efed388ee?ns=docker.io"
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=debug msg="fetch response received" digest="sha256:023917ec6a886d0e8e15f28fb543515a5fcd8d938edb091e8147db4efed388ee" mediatype=application/vnd.docker.distribution.manifest.v2+json response.header.content-length=528 response.header.content-type=application/vnd.docker.distribution.manifest.v2+json response.header.date="Tue, 25 Jun 2024 11:22:04 GMT" response.header.docker-content-digest="sha256:023917ec6a886d0e8e15f28fb543515a5fcd8d938edb091e8147db4efed388ee" response.header.docker-distribution-api-version=registry/2.0 response.header.etag="\"sha256:023917ec6a886d0e8e15f28fb543515a5fcd8d938edb091e8147db4efed388ee\"" response.status="200 OK" size=528 url="http://localhost:46105/v2/library/busybox/manifests/sha256:023917ec6a886d0e8e15f28fb543515a5fcd8d938edb091e8147db4efed388ee?ns=docker.io"
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=debug msg=fetch digest="sha256:a416a98b71e224a31ee99cff8e16063554498227d2b696152a9c3e0aa65e5824" mediatype=application/vnd.docker.container.image.v1+json size=1457
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=debug msg="do request" digest="sha256:a416a98b71e224a31ee99cff8e16063554498227d2b696152a9c3e0aa65e5824" mediatype=application/vnd.docker.container.image.v1+json request.header.accept="application/vnd.docker.container.image.v1+json, */*" request.header.user-agent=buildkit/v0.0.0+unknown request.method=GET size=1457 url="http://localhost:46105/v2/library/busybox/blobs/sha256:a416a98b71e224a31ee99cff8e16063554498227d2b696152a9c3e0aa65e5824?ns=docker.io"
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=debug msg="fetch response received" digest="sha256:a416a98b71e224a31ee99cff8e16063554498227d2b696152a9c3e0aa65e5824" mediatype=application/vnd.docker.container.image.v1+json response.header.accept-ranges=bytes response.header.cache-control="max-age=31536000" response.header.content-length=1457 response.header.content-type=application/octet-stream response.header.date="Tue, 25 Jun 2024 11:22:04 GMT" response.header.docker-content-digest="sha256:a416a98b71e224a31ee99cff8e16063554498227d2b696152a9c3e0aa65e5824" response.header.docker-distribution-api-version=registry/2.0 response.header.etag="\"sha256:a416a98b71e224a31ee99cff8e16063554498227d2b696152a9c3e0aa65e5824\"" response.status="200 OK" size=1457 url="http://localhost:46105/v2/library/busybox/blobs/sha256:a416a98b71e224a31ee99cff8e16063554498227d2b696152a9c3e0aa65e5824?ns=docker.io"
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=debug msg="checked for cached auth handler namespace" cached=true key="docker.io/library/busybox::pull" name=docker.io/library/busybox scope=pull
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=debug msg="checked for cached auth handler namespace" cached=true key="docker.io/library/busybox::pull" name=docker.io/library/busybox scope=pull
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=debug msg=fetch digest="sha256:3f4d90098f5b5a6f6a76e9d217da85aa39b2081e30fa1f7d287138d6e7bf0ad7" mediatype=application/vnd.docker.image.rootfs.diff.tar.gzip size=2219949
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=debug msg="do request" digest="sha256:3f4d90098f5b5a6f6a76e9d217da85aa39b2081e30fa1f7d287138d6e7bf0ad7" mediatype=application/vnd.docker.image.rootfs.diff.tar.gzip request.header.accept="application/vnd.docker.image.rootfs.diff.tar.gzip, */*" request.header.user-agent=containerd/1.7.18+unknown request.method=GET size=2219949 url="http://localhost:46105/v2/library/busybox/blobs/sha256:3f4d90098f5b5a6f6a76e9d217da85aa39b2081e30fa1f7d287138d6e7bf0ad7?ns=docker.io"
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=debug msg="fetch response received" digest="sha256:3f4d90098f5b5a6f6a76e9d217da85aa39b2081e30fa1f7d287138d6e7bf0ad7" mediatype=application/vnd.docker.image.rootfs.diff.tar.gzip response.header.accept-ranges=bytes response.header.cache-control="max-age=31536000" response.header.content-length=2219949 response.header.content-type=application/octet-stream response.header.date="Tue, 25 Jun 2024 11:22:04 GMT" response.header.docker-content-digest="sha256:3f4d90098f5b5a6f6a76e9d217da85aa39b2081e30fa1f7d287138d6e7bf0ad7" response.header.docker-distribution-api-version=registry/2.0 response.header.etag="\"sha256:3f4d90098f5b5a6f6a76e9d217da85aa39b2081e30fa1f7d287138d6e7bf0ad7\"" response.status="200 OK" size=2219949 url="http://localhost:46105/v2/library/busybox/blobs/sha256:3f4d90098f5b5a6f6a76e9d217da85aa39b2081e30fa1f7d287138d6e7bf0ad7?ns=docker.io"
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=debug msg="|<--- Init Message m4joxgrtkojxm10jp0mfekkoj:f9zmppjf2ht4du9vmb64la1vv"
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=debug msg="Starting new container for m4joxgrtkojxm10jp0mfekkoj with args: [\"/bin/sh\" \"-c\" \"nc 127.0.0.1 45943 | grep foo\"]"
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=debug msg="|---> Started Message m4joxgrtkojxm10jp0mfekkoj:f9zmppjf2ht4du9vmb64la1vv"
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=debug msg="|---> Exit Message m4joxgrtkojxm10jp0mfekkoj:f9zmppjf2ht4du9vmb64la1vv, code=255, error=network.host is not allowed"
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=debug msg="|<--- ReleaseContainer m4joxgrtkojxm10jp0mfekkoj"
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=error msg="/moby.buildkit.v1.frontend.LLBBridge/ReleaseContainer returned error: rpc error: code = Unknown desc = network.host is not allowed"
    sandbox.go:136: network.host is not allowed
    sandbox.go:136: 7549 382c315 buildkitd --containerd-worker-gc=false --containerd-worker=true --containerd-worker-addr /tmp/bktest_containerd2544901996/containerd.sock --containerd-worker-labels=org.mobyproject.buildkit.worker.sandbox=true --oci-worker=false --config=/tmp/bktest_config2611257305/buildkitd.toml --root /tmp/bktest_buildkitd4257723819 --addr unix:///tmp/bktest_buildkitd4257723819/buildkitd.sock --debug
    sandbox.go:136: github.com/moby/buildkit/util/entitlements.Set.Check
    sandbox.go:136:     /src/util/entitlements/entitlements.go:65
    sandbox.go:136: github.com/moby/buildkit/solver/llbsolver.(*llbBridge).validateEntitlements
    sandbox.go:136:     /src/solver/llbsolver/bridge.go:174
    sandbox.go:136: github.com/moby/buildkit/solver/llbsolver.(*llbBridge).Run
    sandbox.go:136:     /src/solver/llbsolver/bridge.go:178
    sandbox.go:136: github.com/moby/buildkit/frontend/gateway/container.(*gatewayContainer).Start.func1
    sandbox.go:136:     /src/frontend/gateway/container/container.go:360
    sandbox.go:136: golang.org/x/sync/errgroup.(*Group).Go.func1
    sandbox.go:136:     /src/vendor/golang.org/x/sync/errgroup/errgroup.go:75
    sandbox.go:136: runtime.goexit
    sandbox.go:136:     /usr/local/go/src/runtime/asm_amd64.s:1695
    sandbox.go:136: 
    sandbox.go:136: 7549 382c315 buildkitd --containerd-worker-gc=false --containerd-worker=true --containerd-worker-addr /tmp/bktest_containerd2544901996/containerd.sock --containerd-worker-labels=org.mobyproject.buildkit.worker.sandbox=true --oci-worker=false --config=/tmp/bktest_config2611257305/buildkitd.toml --root /tmp/bktest_buildkitd4257723819 --addr unix:///tmp/bktest_buildkitd4257723819/buildkitd.sock --debug
    sandbox.go:136: main.unaryInterceptor
    sandbox.go:136:     /src/cmd/buildkitd/main.go:713
    sandbox.go:136: google.golang.org/grpc.NewServer.chainUnaryServerInterceptors.chainUnaryInterceptors.func1
    sandbox.go:136:     /src/vendor/google.golang.org/grpc/server.go:1154
    sandbox.go:136: github.com/moby/buildkit/frontend/gateway/pb._LLBBridge_ReleaseContainer_Handler
    sandbox.go:136:     /src/frontend/gateway/pb/gateway.pb.go:3497
    sandbox.go:136: google.golang.org/grpc.(*Server).processUnaryRPC
    sandbox.go:136:     /src/vendor/google.golang.org/grpc/server.go:1343
    sandbox.go:136: google.golang.org/grpc.(*Server).handleStream
    sandbox.go:136:     /src/vendor/google.golang.org/grpc/server.go:1737
    sandbox.go:136: google.golang.org/grpc.(*Server).serveStreams.func1.1
    sandbox.go:136:     /src/vendor/google.golang.org/grpc/server.go:986
    sandbox.go:136: runtime.goexit
    sandbox.go:136:     /usr/local/go/src/runtime/asm_amd64.s:1695
    sandbox.go:136: 
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=debug msg="|---> Done Message m4joxgrtkojxm10jp0mfekkoj:f9zmppjf2ht4du9vmb64la1vv"
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=error msg="/moby.buildkit.v1.Control/Solve returned error: rpc error: code = Unknown desc = expecting started message, got *moby_buildkit_v1_frontend.ExecMessage_Exit"
    sandbox.go:136: expecting started message, got *moby_buildkit_v1_frontend.ExecMessage_Exit
    sandbox.go:136: 7385  /tmp/go-build1702881486/b565/client.test -test.paniconexit0 -test.gocoverdir=/tmp/go-build1702881486/b565/gocoverdir -test.v=test2json -test.v=true -test.parallel=6 -test.timeout=30m0s -test.run=//worker=containerd-1.6$ -test.coverprofile=/tmp/go-build1702881486/b565/_cover_.out
    sandbox.go:136: github.com/moby/buildkit/frontend/gateway/grpcclient.(*container).Start
    sandbox.go:136:     /src/frontend/gateway/grpcclient/client.go:992
    sandbox.go:136: github.com/moby/buildkit/client.testClientGatewayContainerHostNetworking.func1
    sandbox.go:136:     /src/client/build_test.go:2099
    sandbox.go:136: github.com/moby/buildkit/frontend/gateway/grpcclient.(*grpcClient).Run
    sandbox.go:136:     /src/frontend/gateway/grpcclient/client.go:218
    sandbox.go:136: github.com/moby/buildkit/client.(*Client).Build.func2
    sandbox.go:136:     /src/client/build.go:58
    sandbox.go:136: github.com/moby/buildkit/client.(*Client).solve.func3
    sandbox.go:136:     /src/client/solve.go:296
    sandbox.go:136: golang.org/x/sync/errgroup.(*Group).Go.func1
    sandbox.go:136:     /src/vendor/golang.org/x/sync/errgroup/errgroup.go:75
    sandbox.go:136: runtime.goexit
    sandbox.go:136:     /usr/local/go/src/runtime/asm_amd64.s:1695
    sandbox.go:136: 
    sandbox.go:136: 7549 382c315 buildkitd --containerd-worker-gc=false --containerd-worker=true --containerd-worker-addr /tmp/bktest_containerd2544901996/containerd.sock --containerd-worker-labels=org.mobyproject.buildkit.worker.sandbox=true --oci-worker=false --config=/tmp/bktest_config2611257305/buildkitd.toml --root /tmp/bktest_buildkitd4257723819 --addr unix:///tmp/bktest_buildkitd4257723819/buildkitd.sock --debug
    sandbox.go:136: github.com/moby/buildkit/frontend/gateway.(*llbBridgeForwarder).Return
    sandbox.go:136:     /src/frontend/gateway/gateway.go:1023
    sandbox.go:136: github.com/moby/buildkit/control/gateway.(*GatewayForwarder).Return
    sandbox.go:136:     /src/control/gateway/gateway.go:146
    sandbox.go:136: github.com/moby/buildkit/frontend/gateway/pb._LLBBridge_Return_Handler.func1
    sandbox.go:136:     /src/frontend/gateway/pb/gateway.pb.go:3441
    sandbox.go:136: google.golang.org/grpc.getChainUnaryHandler.func1
    sandbox.go:136:     /src/vendor/google.golang.org/grpc/server.go:1163
    sandbox.go:136: main.unaryInterceptor
    sandbox.go:136:     /src/cmd/buildkitd/main.go:709
    sandbox.go:136: google.golang.org/grpc.NewServer.chainUnaryServerInterceptors.chainUnaryInterceptors.func1
    sandbox.go:136:     /src/vendor/google.golang.org/grpc/server.go:1154
    sandbox.go:136: github.com/moby/buildkit/frontend/gateway/pb._LLBBridge_Return_Handler
    sandbox.go:136:     /src/frontend/gateway/pb/gateway.pb.go:3443
    sandbox.go:136: google.golang.org/grpc.(*Server).processUnaryRPC
    sandbox.go:136:     /src/vendor/google.golang.org/grpc/server.go:1343
    sandbox.go:136: google.golang.org/grpc.(*Server).handleStream
    sandbox.go:136:     /src/vendor/google.golang.org/grpc/server.go:1737
    sandbox.go:136: google.golang.org/grpc.(*Server).serveStreams.func1.1
    sandbox.go:136:     /src/vendor/google.golang.org/grpc/server.go:986
    sandbox.go:136: runtime.goexit
    sandbox.go:136:     /usr/local/go/src/runtime/asm_amd64.s:1695
    sandbox.go:136: 
    sandbox.go:136: 7549 382c315 buildkitd --containerd-worker-gc=false --containerd-worker=true --containerd-worker-addr /tmp/bktest_containerd2544901996/containerd.sock --containerd-worker-labels=org.mobyproject.buildkit.worker.sandbox=true --oci-worker=false --config=/tmp/bktest_config2611257305/buildkitd.toml --root /tmp/bktest_buildkitd4257723819 --addr unix:///tmp/bktest_buildkitd4257723819/buildkitd.sock --debug
    sandbox.go:136: main.unaryInterceptor
    sandbox.go:136:     /src/cmd/buildkitd/main.go:713
    sandbox.go:136: google.golang.org/grpc.NewServer.chainUnaryServerInterceptors.chainUnaryInterceptors.func1
    sandbox.go:136:     /src/vendor/google.golang.org/grpc/server.go:1154
    sandbox.go:136: github.com/moby/buildkit/api/services/control._Control_Solve_Handler
    sandbox.go:136:     /src/api/services/control/control.pb.go:2466
    sandbox.go:136: google.golang.org/grpc.(*Server).processUnaryRPC
    sandbox.go:136:     /src/vendor/google.golang.org/grpc/server.go:1343
    sandbox.go:136: google.golang.org/grpc.(*Server).handleStream
    sandbox.go:136:     /src/vendor/google.golang.org/grpc/server.go:1737
    sandbox.go:136: google.golang.org/grpc.(*Server).serveStreams.func1.1
    sandbox.go:136:     /src/vendor/google.golang.org/grpc/server.go:986
    sandbox.go:136: runtime.goexit
    sandbox.go:136:     /usr/local/go/src/runtime/asm_amd64.s:1695
    sandbox.go:136: 
    sandbox.go:136: time="2024-06-25T11:22:04Z" level=debug msg="session finished: <nil>"
    sandbox.go:133: stdout: /opt/containerd-alt-16/bin/containerd --config /tmp/bktest_containerd2544901996/config.toml
    --- FAIL: TestClientGatewayIntegration/TestClientGatewayContainerHostNetworkingValidation/worker=containerd-1.6/netmode=host (1.27s)