Open sasasalamon opened 4 weeks ago
kcq
commented
4 weeks ago @sasasalamon thanks a lot for opening the issue! trying to repro the condition... haven't had much success yet. will post updates as i discover more. just in case, can you share the digest of the redis:latest image you have on your system?
sasasalamon
commented
4 weeks ago redis:latest sha256:0e69d581912e77276656022e2a7f2d51bf25859a8f3792f1bf0f4be632754801 Same happens with the nginx:latest and some other custom images.
kcq
commented
3 weeks ago Tried to repro it with arm64 on Macs and Linux. No luck so far. Tried it with two versions of Docker Desktop on M1 (including the latest version, 27.3.0).
The only/main difference I see is the Mint version. You have 1.41.6 and the latest version is 1.41.7, which is the version I used in my tests. Can you try installing https://github.com/mintoolkit/mint/releases/tag/1.41.7
kcq
commented
3 weeks ago Can you also enable trace logging, so we can get more context for your failure: mint --log-level=trace xray --target redis:latest
sasasalamon
commented
3 weeks ago Thank you so much for helping with this!
When using mint 1.41.7, the error is different:
cmd=xray state=started cmd=xray info=cmd.input.params runtime='auto/docker' target='nginx:latest' add-image-manifest='false' add-image-config='false' rm-file-artifacts='false' cmd=xray state=image.api.inspection.start cmd=xray info=image id='sha256:28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb' size.bytes='69600252' size.human='70 MB' architecture='arm64' cmd=xray info=image.stack index='0' name='nginx:latest' id='sha256:28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb' instructions='18' message='see report file for details' cmd=xray info=image.exposed_ports list='80/tcp' cmd=xray state=image.api.inspection.done cmd=xray state=image.data.inspection.start cmd=xray info=image.data.inspection.save.image.start cmd=xray info=image.data.inspection.save.image.end cmd=xray info=image.data.inspection.process.image.start time="2024-10-31T06:47:13+01:00" level=error msg="layerFromStream: error reading layer(1f62b39dc4019e239fc03465e448d1e220464700fb1a00ea26a7496312d3f18c) - archive/tar: invalid tar header" time="2024-10-31T06:47:13+01:00" level=error msg="dockerimage.LoadPackage: error reading oci layer from archive(/xxx/dist_mac_m1/.mint-state/images/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb/image/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb.tar/blobs/sha256/1f62b39dc4019e239fc03465e448d1e220464700fb1a00ea26a7496312d3f18c) - archive/tar: invalid tar header" time="2024-10-31T06:47:13+01:00" level=fatal msg="slim: failure" error="archive/tar: invalid tar header" stack="goroutine 1 [running]:\nruntime/debug.Stack()\n\truntime/debug/stack.go:26 +0x64\ngithub.com/mintoolkit/mint/pkg/util/errutil.FailOn({0x106893bc8, 0x107e698e0})\n\tgithub.com/mintoolkit/mint/pkg/util/errutil/errutil.go:32 +0x38\ngithub.com/mintoolkit/mint/pkg/app/master/command/xray.OnCommand(0x14000677920, 0x1400071b680, 0x140006773e8, {0x16bddbaed, 0xc}, 0x1, {0x0, 0x0}, {0x0, 0x0}, ...)\n\tgithub.com/mintoolkit/mint/pkg/app/master/command/xray/handler.go:495 +0x30f8\ngithub.com/mintoolkit/mint/pkg/app/master/command/xray.init.func1(0x140006a3c40)\n\tgithub.com/mintoolkit/mint/pkg/app/master/command/xray/cli.go:343 +0x17d4\ngithub.com/urfave/cli/v2.(*Command).Run(0x107ea7980, 0x140006a3c40, {0x140001245a0, 0x3, 0x3})\n\tgithub.com/urfave/cli/v2@v2.27.1/command.go:279 +0x600\ngithub.com/urfave/cli/v2.(*Command).Run(0x14000636580, 0x140006a3640, {0x1400004c100, 0x4, 0x4})\n\tgithub.com/urfave/cli/v2@v2.27.1/command.go:272 +0x83c\ngithub.com/urfave/cli/v2.(*App).RunContext(0x14000704800, {0x1068bdae8, 0x107f29dc0}, {0x1400004c100, 0x4, 0x4})\n\tgithub.com/urfave/cli/v2@v2.27.1/app.go:337 +0x514\ngithub.com/urfave/cli/v2.(*App).Run(...)\n\tgithub.com/urfave/cli/v2@v2.27.1/app.go:311\ngithub.com/mintoolkit/mint/pkg/app/master.Run()\n\tgithub.com/mintoolkit/mint/pkg/app/master/app.go:15 +0x4c\nmain.main()\n\tgithub.com/mintoolkit/mint/cmd/mint/main.go:15 +0x194\n" version="darwin/arm64|Aurora|1.41.7|a2a53d2348aeedf0d650d47debf477a2cad47111|2024-09-25_03:14:07PM"
Here is the log with trace level:
➜ dist_mac_m1 sudo ./mint --log-level=trace xray --target nginx:latest time="2024-10-31T06:49:47+01:00" level=debug msg="sysinfo => system.SystemInfo{Sysname:\"darwin\", Nodename:\"xxx-RH\", Release:\"23.2.0\", Version:\" Wed Nov 15 21:53:18 PST 2023; root:xnu-10002.61.3~2/RELEASE_ARM64_T6000\", Machine:\"arm64\", Domainname:\"\", OsBuild:\"23C71\", Distro:system.DistroInfo{Name:\"\", Version:\"\", DisplayName:\"Sonoma (14.2)\"}}" cmd=xray state=started cmd=xray info=cmd.input.params runtime='auto/docker' target='nginx:latest' add-image-manifest='false' add-image-config='false' rm-file-artifacts='false' time="2024-10-31T06:49:47+01:00" level=trace msg="runtime.handler: rt=auto resolved=docker" app=mint cmd=xray time="2024-10-31T06:49:47+01:00" level=trace msg="dockerclient.New(config=&config.DockerClient{UseTLS:true, VerifyTLS:true, TLSCertPath:\"\", Host:\"\", APIVersion:\"1.32\", Env:map[string]string{}})" time="2024-10-31T06:49:47+01:00" level=debug msg="dockerclient.GetUnixSocketAddr(): found => {\"address\":\"unix:///Users/xxx/.docker/run/docker.sock\",\"file_path\":\"/Users/xxx/.docker/run/docker.sock\",\"type\":\"file\",\"perms\":\"\",\"can_read\":true,\"can_write\":true}\n" time="2024-10-31T06:49:47+01:00" level=debug msg="dockerclient.New: new Docker client (default) [6]" time="2024-10-31T06:49:47+01:00" level=debug msg="dockerclient.New: configured DOCKER_HOST env var" time="2024-10-31T06:49:47+01:00" level=debug msg="dockerclient.New: configured DOCKER_API_VERSION env var" time="2024-10-31T06:49:47+01:00" level=trace msg="image.inspector.NoImage: ImageRef=nginx:latest ImageIdentity=&crt.ImageIdentity{ID:\"sha256:28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb\", ShortTags:[]string{\"latest\"}, RepoTags:[]string{\"nginx:latest\"}, ShortDigests:[]string{\"sha256:28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb\"}, RepoDigests:[]string{\"nginx@sha256:28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb\"}}" cmd=xray state=image.api.inspection.start time="2024-10-31T06:49:47+01:00" level=info msg="inspecting 'fat' image metadata..." app=mint cmd=xray time="2024-10-31T06:49:47+01:00" level=trace msg="image.Inspector.Inspect: ImageInfo=&crt.ImageInfo{Created:time.Date(2024, time.October, 2, 17, 55, 35, 0, time.UTC), ID:\"sha256:28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb\", RepoTags:[]string{\"nginx:latest\"}, RepoDigests:[]string{\"nginx@sha256:28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb\"}, Size:69600252, VirtualSize:69600252, OS:\"linux\", Architecture:\"arm64\", Author:\"\", Config:(*crt.RunConfig)(0x14000728640), RuntimeVersion:\"27.2.0\", RuntimeName:\"docker\"}" time="2024-10-31T06:49:47+01:00" level=trace msg="image.Inspector.Inspect: imageList.size=6" time="2024-10-31T06:49:47+01:00" level=trace msg="image.Inspector.Inspect: target=sha256:28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb record=crt.BasicImageInfo{ID:\"sha256:0e69d581912e77276656022e2a7f2d51bf25859a8f3792f1bf0f4be632754801\", Size:196287687, Created:1728035800, VirtualSize:196287687, ParentID:\"\", RepoTags:[]string{\"redis:latest\"}, RepoDigests:[]string{\"redis@sha256:0e69d581912e77276656022e2a7f2d51bf25859a8f3792f1bf0f4be632754801\"}, Labels:map[string]string(nil)}" time="2024-10-31T06:49:47+01:00" level=trace msg="image.Inspector.Inspect: target=sha256:28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb record=crt.BasicImageInfo{ID:\"sha256:28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb\", Size:281062364, Created:1727891735, VirtualSize:281062364, ParentID:\"\", RepoTags:[]string{\"nginx:latest\"}, RepoDigests:[]string{\"nginx@sha256:28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb\"}, Labels:map[string]string{\"maintainer\":\"NGINX Docker Maintainers <docker-maint@nginx.com>\"}}" time="2024-10-31T06:49:47+01:00" level=debug msg="PrepareImageStateDirs(,sha256:28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb)" time="2024-10-31T06:49:47+01:00" level=debug msg="PrepareImageStateDirs - removing existing state location: /xxx/docker-slim-mint/dist_mac_m1/.mint-state/images/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb/artifacts" time="2024-10-31T06:49:47+01:00" level=debug msg="PrepareImageStateDirs - created new image state location: /xxx/docker-slim-mint/dist_mac_m1/.mint-state/images/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb/artifacts" time="2024-10-31T06:49:47+01:00" level=debug msg="localVolumePath=/xxx/docker-slim-mint/dist_mac_m1/.mint-state/images/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb, artifactLocation=/xxx/docker-slim-mint/dist_mac_m1/.mint-state/images/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb/artifacts, statePath=/xxx/docker-slim-mint/dist_mac_m1, stateKey=28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb" app=mint cmd=xray cmd=xray info=image size.human='70 MB' architecture='arm64' id='sha256:28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb' size.bytes='69600252' time="2024-10-31T06:49:47+01:00" level=info msg="processing 'fat' image info..." app=mint cmd=xray time="2024-10-31T06:49:47+01:00" level=trace msg="\n\nreverse.DockerfileFromHistoryStruct - IMAGE HISTORY:\n[]crt.ImageHistory{crt.ImageHistory{ID:\"sha256:28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb\", Created:1727891735, CreatedBy:\"CMD [\\\"nginx\\\" \\\"-g\\\" \\\"daemon off;\\\"]\", Tags:[]string{\"nginx:latest\"}, Size:0, Comment:\"buildkit.dockerfile.v0\"}, crt.ImageHistory{ID:\"<missing>\", Created:1727891735, CreatedBy:\"STOPSIGNAL SIGQUIT\", Tags:[]string(nil), Size:0, Comment:\"buildkit.dockerfile.v0\"}, crt.ImageHistory{ID:\"<missing>\", Created:1727891735, CreatedBy:\"EXPOSE map[80/tcp:{}]\", Tags:[]string(nil), Size:0, Comment:\"buildkit.dockerfile.v0\"}, crt.ImageHistory{ID:\"<missing>\", Created:1727891735, CreatedBy:\"ENTRYPOINT [\\\"/docker-entrypoint.sh\\\"]\", Tags:[]string(nil), Size:0, Comment:\"buildkit.dockerfile.v0\"}, crt.ImageHistory{ID:\"<missing>\", Created:1727891735, CreatedBy:\"COPY 30-tune-worker-processes.sh /docker-entrypoint.d # buildkit\", Tags:[]string(nil), Size:16384, Comment:\"buildkit.dockerfile.v0\"}, crt.ImageHistory{ID:\"<missing>\", Created:1727891735, CreatedBy:\"COPY 20-envsubst-on-templates.sh /docker-entrypoint.d # buildkit\", Tags:[]string(nil), Size:12288, Comment:\"buildkit.dockerfile.v0\"}, crt.ImageHistory{ID:\"<missing>\", Created:1727891735, CreatedBy:\"COPY 15-local-resolvers.envsh /docker-entrypoint.d # buildkit\", Tags:[]string(nil), Size:12288, Comment:\"buildkit.dockerfile.v0\"}, crt.ImageHistory{ID:\"<missing>\", Created:1727891735, CreatedBy:\"COPY 10-listen-on-ipv6-by-default.sh /docker-entrypoint.d # buildkit\", Tags:[]string(nil), Size:12288, Comment:\"buildkit.dockerfile.v0\"}, crt.ImageHistory{ID:\"<missing>\", Created:1727891735, CreatedBy:\"COPY docker-entrypoint.sh / # buildkit\", Tags:[]string(nil), Size:8192, Comment:\"buildkit.dockerfile.v0\"}, crt.ImageHistory{ID:\"<missing>\", Created:1727891735, CreatedBy:\"RUN /bin/sh -c set -x && groupadd --system --gid 101 nginx && useradd --system --gid nginx --no-create-home --home /nonexistent --comment \\\"nginx user\\\" --shell /bin/false --uid 101 nginx && apt-get update && apt-get install --no-install-recommends --no-install-suggests -y gnupg1 ca-certificates && NGINX_GPGKEYS=\\\"573BFD6B3D8FBC641079A6ABABF5BD827BD9BF62 8540A6F18833A80E9C1653A42FD21310B49F6B46 9E9BE90EACBCDE69FE9B204CBCDCD8A38D88A2B3\\\"; NGINX_GPGKEY_PATH=/etc/apt/keyrings/nginx-archive-keyring.gpg; export GNUPGHOME=\\\"$(mktemp -d)\\\"; found=''; for NGINX_GPGKEY in $NGINX_GPGKEYS; do for server in hkp://keyserver.ubuntu.com:80 pgp.mit.edu ; do echo \\\"Fetching GPG key $NGINX_GPGKEY from $server\\\"; gpg1 --keyserver \\\"$server\\\" --keyserver-options timeout=10 --recv-keys \\\"$NGINX_GPGKEY\\\" && found=yes && break; done; test -z \\\"$found\\\" && echo >&2 \\\"error: failed to fetch GPG key $NGINX_GPGKEY\\\" && exit 1; done; gpg1 --export \\\"$NGINX_GPGKEYS\\\" > \\\"$NGINX_GPGKEY_PATH\\\" ; rm -rf \\\"$GNUPGHOME\\\"; apt-get remove --purge --auto-remove -y gnupg1 && rm -rf /var/lib/apt/lists/* && dpkgArch=\\\"$(dpkg --print-architecture)\\\" && nginxPackages=\\\" nginx=${NGINX_VERSION}-${PKG_RELEASE} nginx-module-xslt=${NGINX_VERSION}-${DYNPKG_RELEASE} nginx-module-geoip=${NGINX_VERSION}-${DYNPKG_RELEASE} nginx-module-image-filter=${NGINX_VERSION}-${DYNPKG_RELEASE} nginx-module-njs=${NGINX_VERSION}+${NJS_VERSION}-${NJS_RELEASE} \\\" && case \\\"$dpkgArch\\\" in amd64|arm64) echo \\\"deb [signed-by=$NGINX_GPGKEY_PATH] https://nginx.org/packages/mainline/debian/ bookworm nginx\\\" >> /etc/apt/sources.list.d/nginx.list && apt-get update ;; *) tempDir=\\\"$(mktemp -d)\\\" && chmod 777 \\\"$tempDir\\\" && savedAptMark=\\\"$(apt-mark showmanual)\\\" && apt-get update && apt-get install --no-install-recommends --no-install-suggests -y curl devscripts equivs git libxml2-utils lsb-release xsltproc && ( cd \\\"$tempDir\\\" && REVISION=\\\"${NGINX_VERSION}-${PKG_RELEASE}\\\" && REVISION=${REVISION%~*} && curl -f -L -O https://github.com/nginx/pkg-oss/archive/${REVISION}.tar.gz && PKGOSSCHECKSUM=\\\"6982e2df739645fc72db5bdf994032f799718230e7016e811d9d482e5cf41814c888660ca9a68814d5e99ab571e892ada3bd43166e720cbf04c7f85b6934772c *${REVISION}.tar.gz\\\" && if [ \\\"$(openssl sha512 -r ${REVISION}.tar.gz)\\\" = \\\"$PKGOSSCHECKSUM\\\" ]; then echo \\\"pkg-oss tarball checksum verification succeeded!\\\"; else echo \\\"pkg-oss tarball checksum verification failed!\\\"; exit 1; fi && tar xzvf ${REVISION}.tar.gz && cd pkg-oss-${REVISION} && cd debian && for target in base module-geoip module-image-filter module-njs module-xslt; do make rules-$target; mk-build-deps --install --tool=\\\"apt-get -o Debug::pkgProblemResolver=yes --no-install-recommends --yes\\\" debuild-$target/nginx-$NGINX_VERSION/debian/control; done && make base module-geoip module-image-filter module-njs module-xslt ) && apt-mark showmanual | xargs apt-mark auto > /dev/null && { [ -z \\\"$savedAptMark\\\" ] || apt-mark manual $savedAptMark; } && ls -lAFh \\\"$tempDir\\\" && ( cd \\\"$tempDir\\\" && dpkg-scanpackages . > Packages ) && grep '^Package: ' \\\"$tempDir/Packages\\\" && echo \\\"deb [ trusted=yes ] file://$tempDir ./\\\" > /etc/apt/sources.list.d/temp.list && apt-get -o Acquire::GzipIndexes=false update ;; esac && apt-get install --no-install-recommends --no-install-suggests -y $nginxPackages gettext-base curl && apt-get remove --purge --auto-remove -y && rm -rf /var/lib/apt/lists/* /etc/apt/sources.list.d/nginx.list && if [ -n \\\"$tempDir\\\" ]; then apt-get purge -y --auto-remove && rm -rf \\\"$tempDir\\\" /etc/apt/sources.list.d/temp.list; fi && ln -sf /dev/stdout /var/log/nginx/access.log && ln -sf /dev/stderr /var/log/nginx/error.log && mkdir /docker-entrypoint.d # buildkit\", Tags:[]string(nil), Size:103768064, Comment:\"buildkit.dockerfile.v0\"}, crt.ImageHistory{ID:\"<missing>\", Created:1727891735, CreatedBy:\"ENV DYNPKG_RELEASE=1~bookworm\", Tags:[]string(nil), Size:0, Comment:\"buildkit.dockerfile.v0\"}, crt.ImageHistory{ID:\"<missing>\", Created:1727891735, CreatedBy:\"ENV PKG_RELEASE=1~bookworm\", Tags:[]string(nil), Size:0, Comment:\"buildkit.dockerfile.v0\"}, crt.ImageHistory{ID:\"<missing>\", Created:1727891735, CreatedBy:\"ENV NJS_RELEASE=1~bookworm\", Tags:[]string(nil), Size:0, Comment:\"buildkit.dockerfile.v0\"}, crt.ImageHistory{ID:\"<missing>\", Created:1727891735, CreatedBy:\"ENV NJS_VERSION=0.8.6\", Tags:[]string(nil), Size:0, Comment:\"buildkit.dockerfile.v0\"}, crt.ImageHistory{ID:\"<missing>\", Created:1727891735, CreatedBy:\"ENV NGINX_VERSION=1.27.2\", Tags:[]string(nil), Size:0, Comment:\"buildkit.dockerfile.v0\"}, crt.ImageHistory{ID:\"<missing>\", Created:1727891735, CreatedBy:\"LABEL maintainer=NGINX Docker Maintainers <docker-maint@nginx.com>\", Tags:[]string(nil), Size:0, Comment:\"buildkit.dockerfile.v0\"}, crt.ImageHistory{ID:\"<missing>\", Created:1727891735, CreatedBy:\"/bin/sh -c #(nop) CMD [\\\"bash\\\"]\", Tags:[]string(nil), Size:0, Comment:\"\"}, crt.ImageHistory{ID:\"<missing>\", Created:1727891735, CreatedBy:\"/bin/sh -c #(nop) ADD file:702193928cded0bcec5edbf4a5660961e7caef8c9d9cafea3337b7f6720c4464 in / \", Tags:[]string(nil), Size:107642880, Comment:\"\"}}\n\n" time="2024-10-31T06:49:47+01:00" level=debug msg="IMAGE INSTRUCTIONS:" time="2024-10-31T06:49:47+01:00" level=debug msg="FROM scratch" time="2024-10-31T06:49:47+01:00" level=debug msg="# new image" time="2024-10-31T06:49:47+01:00" level=debug msg="\n# instruction set group 1\n" time="2024-10-31T06:49:47+01:00" level=debug msg="ADD file:702193928cded0bcec5edbf4a5660961e7caef8c9d9cafea3337b7f6720c4464 /" time="2024-10-31T06:49:47+01:00" level=debug msg="CMD [\"bash\"]\n" time="2024-10-31T06:49:47+01:00" level=debug msg="# buildkit.dockerfile.v0 (a buildkit instruction)" time="2024-10-31T06:49:47+01:00" level=debug msg="LABEL maintainer=NGINX Docker Maintainers <docker-maint@nginx.com>" time="2024-10-31T06:49:47+01:00" level=debug msg="# buildkit.dockerfile.v0 (a buildkit instruction)" time="2024-10-31T06:49:47+01:00" level=debug msg="ENV NGINX_VERSION=1.27.2" time="2024-10-31T06:49:47+01:00" level=debug msg="# buildkit.dockerfile.v0 (a buildkit instruction)" time="2024-10-31T06:49:47+01:00" level=debug msg="ENV NJS_VERSION=0.8.6" time="2024-10-31T06:49:47+01:00" level=debug msg="# buildkit.dockerfile.v0 (a buildkit instruction)" time="2024-10-31T06:49:47+01:00" level=debug msg="ENV NJS_RELEASE=1~bookworm" time="2024-10-31T06:49:47+01:00" level=debug msg="# buildkit.dockerfile.v0 (a buildkit instruction)" time="2024-10-31T06:49:47+01:00" level=debug msg="ENV PKG_RELEASE=1~bookworm" time="2024-10-31T06:49:47+01:00" level=debug msg="# buildkit.dockerfile.v0 (a buildkit instruction)" time="2024-10-31T06:49:47+01:00" level=debug msg="ENV DYNPKG_RELEASE=1~bookworm" time="2024-10-31T06:49:47+01:00" level=debug msg="# buildkit.dockerfile.v0 (a buildkit instruction)" time="2024-10-31T06:49:47+01:00" level=debug msg="RUN set -x && \\\n\tgroupadd --system --gid 101 nginx && \\\n\tuseradd --system --gid nginx --no-create-home --home /nonexistent --comment \"nginx user\" --shell /bin/false --uid 101 nginx && \\\n\tapt-get update && \\\n\tapt-get install --no-install-recommends --no-install-suggests -y gnupg1 ca-certificates && \\\n\tNGINX_GPGKEYS=\"573BFD6B3D8FBC641079A6ABABF5BD827BD9BF62 8540A6F18833A80E9C1653A42FD21310B49F6B46 9E9BE90EACBCDE69FE9B204CBCDCD8A38D88A2B3\"; NGINX_GPGKEY_PATH=/etc/apt/keyrings/nginx-archive-keyring.gpg; export GNUPGHOME=\"$(mktemp -d)\"; found=''; for NGINX_GPGKEY in $NGINX_GPGKEYS; do for server in hkp://keyserver.ubuntu.com:80 pgp.mit.edu ; do echo \"Fetching GPG key $NGINX_GPGKEY from $server\"; gpg1 --keyserver \"$server\" --keyserver-options timeout=10 --recv-keys \"$NGINX_GPGKEY\" && \\\n\tfound=yes && \\\n\tbreak; done; test -z \"$found\" && \\\n\techo >&2 \"error: failed to fetch GPG key $NGINX_GPGKEY\" && \\\n\texit 1; done; gpg1 --export \"$NGINX_GPGKEYS\" > \"$NGINX_GPGKEY_PATH\" ; rm -rf \"$GNUPGHOME\"; apt-get remove --purge --auto-remove -y gnupg1 && \\\n\trm -rf /var/lib/apt/lists/* && \\\n\tdpkgArch=\"$(dpkg --print-architecture)\" && \\\n\tnginxPackages=\" nginx=${NGINX_VERSION}-${PKG_RELEASE} nginx-module-xslt=${NGINX_VERSION}-${DYNPKG_RELEASE} nginx-module-geoip=${NGINX_VERSION}-${DYNPKG_RELEASE} nginx-module-image-filter=${NGINX_VERSION}-${DYNPKG_RELEASE} nginx-module-njs=${NGINX_VERSION}+${NJS_VERSION}-${NJS_RELEASE} \" && \\\n\tcase \"$dpkgArch\" in amd64|arm64) echo \"deb [signed-by=$NGINX_GPGKEY_PATH] https://nginx.org/packages/mainline/debian/ bookworm nginx\" >> /etc/apt/sources.list.d/nginx.list && \\\n\tapt-get update ;; *) tempDir=\"$(mktemp -d)\" && \\\n\tchmod 777 \"$tempDir\" && \\\n\tsavedAptMark=\"$(apt-mark showmanual)\" && \\\n\tapt-get update && \\\n\tapt-get install --no-install-recommends --no-install-suggests -y curl devscripts equivs git libxml2-utils lsb-release xsltproc && \\\n\t( cd \"$tempDir\" && \\\n\tREVISION=\"${NGINX_VERSION}-${PKG_RELEASE}\" && \\\n\tREVISION=${REVISION%~*} && \\\n\tcurl -f -L -O https://github.com/nginx/pkg-oss/archive/${REVISION}.tar.gz && \\\n\tPKGOSSCHECKSUM=\"6982e2df739645fc72db5bdf994032f799718230e7016e811d9d482e5cf41814c888660ca9a68814d5e99ab571e892ada3bd43166e720cbf04c7f85b6934772c *${REVISION}.tar.gz\" && \\\n\tif [ \"$(openssl sha512 -r ${REVISION}.tar.gz)\" = \"$PKGOSSCHECKSUM\" ]; then echo \"pkg-oss tarball checksum verification succeeded!\"; else echo \"pkg-oss tarball checksum verification failed!\"; exit 1; fi && \\\n\ttar xzvf ${REVISION}.tar.gz && \\\n\tcd pkg-oss-${REVISION} && \\\n\tcd debian && \\\n\tfor target in base module-geoip module-image-filter module-njs module-xslt; do make rules-$target; mk-build-deps --install --tool=\"apt-get -o Debug::pkgProblemResolver=yes --no-install-recommends --yes\" debuild-$target/nginx-$NGINX_VERSION/debian/control; done && \\\n\tmake base module-geoip module-image-filter module-njs module-xslt ) && \\\n\tapt-mark showmanual | xargs apt-mark auto > /dev/null && \\\n\t{ [ -z \"$savedAptMark\" ] || apt-mark manual $savedAptMark; } && \\\n\tls -lAFh \"$tempDir\" && \\\n\t( cd \"$tempDir\" && \\\n\tdpkg-scanpackages . > Packages ) && \\\n\tgrep '^Package: ' \"$tempDir/Packages\" && \\\n\techo \"deb [ trusted=yes ] file://$tempDir ./\" > /etc/apt/sources.list.d/temp.list && \\\n\tapt-get -o Acquire::GzipIndexes=false update ;; esac && \\\n\tapt-get install --no-install-recommends --no-install-suggests -y $nginxPackages gettext-base curl && \\\n\tapt-get remove --purge --auto-remove -y && \\\n\trm -rf /var/lib/apt/lists/* /etc/apt/sources.list.d/nginx.list && \\\n\tif [ -n \"$tempDir\" ]; then apt-get purge -y --auto-remove && \\\n\trm -rf \"$tempDir\" /etc/apt/sources.list.d/temp.list; fi && \\\n\tln -sf /dev/stdout /var/log/nginx/access.log && \\\n\tln -sf /dev/stderr /var/log/nginx/error.log && \\\n\tmkdir /docker-entrypoint.d" time="2024-10-31T06:49:47+01:00" level=debug msg="# buildkit.dockerfile.v0 (a buildkit instruction)" time="2024-10-31T06:49:47+01:00" level=debug msg="COPY docker-entrypoint.sh /" time="2024-10-31T06:49:47+01:00" level=debug msg="# buildkit.dockerfile.v0 (a buildkit instruction)" time="2024-10-31T06:49:47+01:00" level=debug msg="COPY 10-listen-on-ipv6-by-default.sh /docker-entrypoint.d" time="2024-10-31T06:49:47+01:00" level=debug msg="# buildkit.dockerfile.v0 (a buildkit instruction)" time="2024-10-31T06:49:47+01:00" level=debug msg="COPY 15-local-resolvers.envsh /docker-entrypoint.d" time="2024-10-31T06:49:47+01:00" level=debug msg="# buildkit.dockerfile.v0 (a buildkit instruction)" time="2024-10-31T06:49:47+01:00" level=debug msg="COPY 20-envsubst-on-templates.sh /docker-entrypoint.d" time="2024-10-31T06:49:47+01:00" level=debug msg="# buildkit.dockerfile.v0 (a buildkit instruction)" time="2024-10-31T06:49:47+01:00" level=debug msg="COPY 30-tune-worker-processes.sh /docker-entrypoint.d" time="2024-10-31T06:49:47+01:00" level=debug msg="# buildkit.dockerfile.v0 (a buildkit instruction)" time="2024-10-31T06:49:47+01:00" level=debug msg="ENTRYPOINT [\"/docker-entrypoint.sh\"]\n" time="2024-10-31T06:49:47+01:00" level=debug msg="# buildkit.dockerfile.v0 (a buildkit instruction)" time="2024-10-31T06:49:47+01:00" level=debug msg="EXPOSE 80/tcp" time="2024-10-31T06:49:47+01:00" level=debug msg="# buildkit.dockerfile.v0 (a buildkit instruction)" time="2024-10-31T06:49:47+01:00" level=debug msg="STOPSIGNAL SIGQUIT" time="2024-10-31T06:49:47+01:00" level=debug msg="# buildkit.dockerfile.v0 (a buildkit instruction)" time="2024-10-31T06:49:47+01:00" level=debug msg="CMD [\"nginx\",\"-g\",\"daemon off;\"]\n" time="2024-10-31T06:49:47+01:00" level=debug msg="# end of image: nginx:latest (id: tags: nginx:latest)" time="2024-10-31T06:49:47+01:00" level=debug cmd=xray info=image.stack index='0' name='nginx:latest' id='sha256:28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb' instructions='18' message='see report file for details' cmd=xray info=image.exposed_ports list='80/tcp' cmd=xray state=image.api.inspection.done cmd=xray state=image.data.inspection.start time="2024-10-31T06:49:47+01:00" level=debug msg="exported image already exists - /xxx/docker-slim-mint/dist_mac_m1/.mint-state/images/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb/image/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb.tar" app=mint cmd=xray cmd=xray info=image.data.inspection.process.image.start time="2024-10-31T06:49:47+01:00" level=trace msg="dockerimage.LoadPackage.jsonFromStream: name='index.json' data[317]='{\"schemaVersion\":2,\"mediaType\":\"application/vnd.oci.image.index.v1+json\",\"manifests\":[{\"mediaType\":\"application/vnd.oci.image.index.v1+json\",\"digest\":\"sha256:28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb\",\"size\":10272,\"annotations\":{\"containerd.io/distribution.source.docker.io\":\"library/nginx\"}}]}' source='/xxx/docker-slim-mint/dist_mac_m1/.mint-state/images/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb/image/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb.tar'" time="2024-10-31T06:49:47+01:00" level=debug msg="dockerimage.LoadPackage: oci index from archive(/xxx/docker-slim-mint/dist_mac_m1/.mint-state/images/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb/image/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb.tar/index.json) has no image manifest references - '{\"schemaVersion\":2,\"mediaType\":\"application/vnd.oci.image.index.v1+json\",\"manifests\":[{\"mediaType\":\"application/vnd.oci.image.index.v1+json\",\"digest\":\"sha256:28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb\",\"size\":10272,\"annotations\":{\"containerd.io/distribution.source.docker.io\":\"library/nginx\"}}]}\n'" time="2024-10-31T06:49:47+01:00" level=trace msg="dockerimage.LoadPackage: oci index from archive(/xxx/docker-slim-mint/dist_mac_m1/.mint-state/images/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb/image/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb.tar/index.json) [found oci image manifest desc - 'false'] = {\"schemaVersion\":2,\"mediaType\":\"application/vnd.oci.image.index.v1+json\",\"manifests\":[{\"mediaType\":\"application/vnd.oci.image.index.v1+json\",\"digest\":\"sha256:28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb\",\"size\":10272,\"annotations\":{\"containerd.io/distribution.source.docker.io\":\"library/nginx\"}}]}\n" time="2024-10-31T06:49:47+01:00" level=trace msg="dockerimage.LoadPackage.jsonFromStream: name='manifest.json' data[679]='[{\"Config\":\"blobs/sha256/4b196525bd3cc6aa7a72ba63c6c2ae6d957b57edd603a7070c5e31f8e63c51f9\",\"RepoTags\":null,\"Layers\":[\"blobs/sha256/83d624c4be2db5b81ae220b6b10cbc9a559d5800fd32556f4020727098f71ed0\",\"blobs/sha256/1f62b39dc4019e239fc03465e448d1e220464700fb1a00ea26a7496312d3f18c\",\"blobs/sha256/6c29a458e7d538fa8ce109692a975b84e2dc3b438aed0720e8abd5a16df9b027\",\"blobs/sha256/805908969407cd99471c7dafb11745e73ed486c68d6367ea252a754fb98b2f54\",\"blobs/sha256/2c1384c8653949a82986bb9fe62f0be7e3d1c91ed576d3e17706acb227d48276\",\"blobs/sha256/b9a670e7a7f3704da74f73cc4fc83aed075bcc4dbbdaacf57f0c0288ec981949\",\"blobs/sha256/51635e63ab0c53cbc2bfce9bbbd553cc429e26e2be2d517acd7a3697b2358074\"]}]' source='/xxx/docker-slim-mint/dist_mac_m1/.mint-state/images/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb/image/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb.tar'" time="2024-10-31T06:49:47+01:00" level=trace msg="dockerimage.LoadPackage: Docker manifest from archive(/xxx/docker-slim-mint/dist_mac_m1/.mint-state/images/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb/image/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb.tar/manifest.json) = [{\"Config\":\"blobs/sha256/4b196525bd3cc6aa7a72ba63c6c2ae6d957b57edd603a7070c5e31f8e63c51f9\",\"Layers\":[\"blobs/sha256/83d624c4be2db5b81ae220b6b10cbc9a559d5800fd32556f4020727098f71ed0\",\"blobs/sha256/1f62b39dc4019e239fc03465e448d1e220464700fb1a00ea26a7496312d3f18c\",\"blobs/sha256/6c29a458e7d538fa8ce109692a975b84e2dc3b438aed0720e8abd5a16df9b027\",\"blobs/sha256/805908969407cd99471c7dafb11745e73ed486c68d6367ea252a754fb98b2f54\",\"blobs/sha256/2c1384c8653949a82986bb9fe62f0be7e3d1c91ed576d3e17706acb227d48276\",\"blobs/sha256/b9a670e7a7f3704da74f73cc4fc83aed075bcc4dbbdaacf57f0c0288ec981949\",\"blobs/sha256/51635e63ab0c53cbc2bfce9bbbd553cc429e26e2be2d517acd7a3697b2358074\"]}]\n" time="2024-10-31T06:49:47+01:00" level=trace msg="dockerimage.LoadPackage.jsonFromStream: name='oci-layout' data[30]='{\"imageLayoutVersion\":\"1.0.0\"}' source='/xxx/docker-slim-mint/dist_mac_m1/.mint-state/images/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb/image/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb.tar'" time="2024-10-31T06:49:47+01:00" level=trace msg="dockerimage.LoadPackage: archive(/xxx/docker-slim-mint/dist_mac_m1/.mint-state/images/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb/image/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb.tar) - tfc=15, archiveFiles=15 [dm=true/dv1config=false/dv1layer=false/ocilayout=true/ociindex=true/ociblobs=true]" time="2024-10-31T06:49:47+01:00" level=debug msg="dockerimage.LoadPackage: pkg.Format=docker.oci pkg.IsOCI=true archive - (/xxx/docker-slim-mint/dist_mac_m1/.mint-state/images/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb/image/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb.tar)" time="2024-10-31T06:49:47+01:00" level=trace msg="dockerimage.LoadPackage: archive(/xxx/docker-slim-mint/dist_mac_m1/.mint-state/images/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb/image/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb.tar) - DM - config object path = 'blobs/sha256/4b196525bd3cc6aa7a72ba63c6c2ae6d957b57edd603a7070c5e31f8e63c51f9'" time="2024-10-31T06:49:47+01:00" level=trace msg="dockerimage.LoadPackage: archive(/xxx/docker-slim-mint/dist_mac_m1/.mint-state/images/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb/image/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb.tar) - DM - layer paths [7] = 'map[string]struct {}{\"blobs/sha256/1f62b39dc4019e239fc03465e448d1e220464700fb1a00ea26a7496312d3f18c\":struct {}{}, \"blobs/sha256/2c1384c8653949a82986bb9fe62f0be7e3d1c91ed576d3e17706acb227d48276\":struct {}{}, \"blobs/sha256/51635e63ab0c53cbc2bfce9bbbd553cc429e26e2be2d517acd7a3697b2358074\":struct {}{}, \"blobs/sha256/6c29a458e7d538fa8ce109692a975b84e2dc3b438aed0720e8abd5a16df9b027\":struct {}{}, \"blobs/sha256/805908969407cd99471c7dafb11745e73ed486c68d6367ea252a754fb98b2f54\":struct {}{}, \"blobs/sha256/83d624c4be2db5b81ae220b6b10cbc9a559d5800fd32556f4020727098f71ed0\":struct {}{}, \"blobs/sha256/b9a670e7a7f3704da74f73cc4fc83aed075bcc4dbbdaacf57f0c0288ec981949\":struct {}{}}'" time="2024-10-31T06:49:47+01:00" level=error msg="layerFromStream: error reading layer(1f62b39dc4019e239fc03465e448d1e220464700fb1a00ea26a7496312d3f18c) - archive/tar: invalid tar header" time="2024-10-31T06:49:47+01:00" level=error msg="dockerimage.LoadPackage: error reading oci layer from archive(/xxx/docker-slim-mint/dist_mac_m1/.mint-state/images/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb/image/28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb.tar/blobs/sha256/1f62b39dc4019e239fc03465e448d1e220464700fb1a00ea26a7496312d3f18c) - archive/tar: invalid tar header" time="2024-10-31T06:49:47+01:00" level=fatal msg="slim: failure" error="archive/tar: invalid tar header" stack="goroutine 1 [running]:\nruntime/debug.Stack()\n\truntime/debug/stack.go:26 +0x64\ngithub.com/mintoolkit/mint/pkg/util/errutil.FailOn({0x104d2bbc8, 0x1063018e0})\n\tgithub.com/mintoolkit/mint/pkg/util/errutil/errutil.go:32 +0x38\ngithub.com/mintoolkit/mint/pkg/app/master/command/xray.OnCommand(0x140006bb920, 0x1400047a000, 0x140006bb3e8, {0x16d943adf, 0xc}, 0x1, {0x0, 0x0}, {0x0, 0x0}, ...)\n\tgithub.com/mintoolkit/mint/pkg/app/master/command/xray/handler.go:495 +0x30f8\ngithub.com/mintoolkit/mint/pkg/app/master/command/xray.init.func1(0x140004327c0)\n\tgithub.com/mintoolkit/mint/pkg/app/master/command/xray/cli.go:343 +0x17d4\ngithub.com/urfave/cli/v2.(*Command).Run(0x10633f980, 0x140004327c0, {0x1400045e630, 0x3, 0x3})\n\tgithub.com/urfave/cli/v2@v2.27.1/command.go:279 +0x600\ngithub.com/urfave/cli/v2.(*Command).Run(0x14000464160, 0x14000432140, {0x1400004c0a0, 0x5, 0x5})\n\tgithub.com/urfave/cli/v2@v2.27.1/command.go:272 +0x83c\ngithub.com/urfave/cli/v2.(*App).RunContext(0x14000456000, {0x104d55ae8, 0x1063c1dc0}, {0x1400004c0a0, 0x5, 0x5})\n\tgithub.com/urfave/cli/v2@v2.27.1/app.go:337 +0x514\ngithub.com/urfave/cli/v2.(*App).Run(...)\n\tgithub.com/urfave/cli/v2@v2.27.1/app.go:311\ngithub.com/mintoolkit/mint/pkg/app/master.Run()\n\tgithub.com/mintoolkit/mint/pkg/app/master/app.go:15 +0x4c\nmain.main()\n\tgithub.com/mintoolkit/mint/cmd/mint/main.go:15 +0x194\n" version="darwin/arm64|Aurora|1.41.7|a2a53d2348aeedf0d650d47debf477a2cad47111|2024-09-25_03:14:07PM"
kcq
commented
3 weeks ago great info. thanks a lot! very useful for debugging
kcq
commented
1 week ago haven't been able to repro it... still trying
Expected Behavior
xray --target redis:latest
Actual Behavior
xray --target redis:latest
Steps to Reproduce the Problem
1. 1. 1. --- Specifications ================= - Version: mint version darwin/amd64|Aurora|1.41.6|53e8072bb239bc3cad5b26a14f3ab8b678db0c9a|2024-08-25_12:53:40AM - Platform: Client: Version: 27.2.0 Context: desktop-linux Debug Mode: false Server: Server Version: 27.2.0 Storage Driver: overlayfs driver-type: io.containerd.snapshotter.v1 Runtimes: io.containerd.runc.v2 runc Default Runtime: runc Init Binary: docker-init containerd version: 8fc6bcff51318944179630522a095cc9dbf9f353 runc version: v1.1.13-0-g58aa920 init version: de40ad0 Security Options: seccomp Profile: unconfined cgroupns Kernel Version: 6.10.4-linuxkit Operating System: Docker Desktop OSType: linux Architecture: aarch64 Name: docker-desktop Docker Root Dir: /var/lib/docker Debug Mode: false HTTP Proxy: http.docker.internal:3128 HTTPS Proxy: http.docker.internal:3128 No Proxy: hubproxy.docker.internal Experimental: false