Closed erez-levi closed 1 week ago
crazy-max
commented
1 week ago @erez-levi Thanks! Do you have a summary generated for this build?: https://docs.docker.com/build/ci/github-actions/build-summary/
If so can you attach the .dockerbuild record like this one:
erez-levi
commented
1 week ago @crazy-max Hi, I attached all of the files from this as attachments
crazy-max
commented
1 week ago @crazy-max Hi, I attached all of the files from this as attachments
Ok so no .dockerbuild file from summary iiuc?
erez-levi
commented
1 week ago those files are exported from the .dockerbuild after I went over them to make sure I am not exposing anything private from my org, so those are the contents of the .dockerbuild as you requested
crazy-max
commented
1 week ago @erez-levi For "Workflow logs" can you show the full logs of name: Build image step please? Want to check builder information like: https://github.com/docker/build-push-action/actions/runs/11814963949/job/32915142064#step:6:121
And
As well.
erez-levi
commented
1 week ago {
"nodes": [
{
"name": "builder-828661dc-b680-4e3d-84ab-8e499aa3a5ed0",
"endpoint": "unix:///var/run/docker.sock",
"status": "running",
"buildkitd-flags": "--debug --allow-insecure-entitlement=network.host",
"buildkit": "v0.17.1",
"platforms": "linux/amd64,linux/amd64/v2,linux/amd64/v3,linux/amd64/v4,linux/arm64,linux/riscv64,linux/ppc64le,linux/s390x,linux/386,linux/arm/v7,linux/arm/v6",
"features": {
"Automatically load images to the Docker Engine image store": true,
"Cache export": true,
"Docker exporter": true,
"Multi-platform build": true,
"OCI exporter": true
},
"labels": {
"org.mobyproject.buildkit.worker.executor": "oci",
"org.mobyproject.buildkit.worker.hostname": "c9737dba4b68",
"org.mobyproject.buildkit.worker.network": "host",
"org.mobyproject.buildkit.worker.oci.process-mode": "sandbox",
"org.mobyproject.buildkit.worker.selinux.enabled": "false",
"org.mobyproject.buildkit.worker.snapshotter": "overlayfs"
},
"gcPolicy": [
{
"all": false,
"filter": [
"type==source.local",
"type==exec.cachemount",
"type==source.git.checkout"
],
"keepDuration": "48h0m0s"
},
{
"all": false,
"keepDuration": "1440h0m0s",
"keepBytes": "9.313GiB"
},
{
"all": false,
"keepBytes": "9.313GiB"
},
{
"all": true,
"keepBytes": "9.313GiB"
}
]
}
],
"name": "builder-828661dc-b680-4e3d-84ab-8e499aa3a5ed",
"driver": "docker-container",
"lastActivity": "2024-11-13T09:42:01.000Z"
} /usr/bin/docker buildx version
github.com/docker/buildx v0.16.2 99dea6dacacc3d604788953088560b9880550570 /usr/bin/docker version
Client:
Version: 27.1.1
API version: 1.46
Go version: go1.21.12
Git commit: 6312585
Built: Tue Jul 23 19:55:52 2024
OS/Arch: linux/amd64
Context: default
Server: Docker Engine - Community
Engine:
Version: 27.3.1
API version: 1.47 (minimum version 1.24)
Go version: go1.22.7
Git commit: 41ca978
Built: Fri Sep 20 11:41:02 2024
OS/Arch: linux/amd64
Experimental: false
containerd:
Version: v1.7.22
GitCommit: 7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c
runc:
Version: 1.1.14
GitCommit: v1.1.14-0-g2c9f560
docker-init:
Version: 0.19.0
GitCommit: de40ad0
/usr/bin/docker info
Client:
Version: 27.1.1
Context: default
Debug Mode: false
Plugins:
buildx: Docker Buildx (Docker Inc.)
Version: v0.16.2
Path: /usr/local/lib/docker/cli-plugins/docker-buildx
Server:
Containers: 1
Running: 1
Paused: 0
Stopped: 0
Images: 2
Server Version: 27.3.1
Storage Driver: overlay2
Backing Filesystem: extfs
Supports d_type: true
Using metacopy: false
Native Overlay Diff: true
userxattr: false
Logging Driver: json-file
Cgroup Driver: cgroupfs
Cgroup Version: 2
Plugins:
Volume: local
Network: bridge host ipvlan macvlan null overlay
Log: awslogs fluentd gcplogs gelf journald json-file local splunk syslog
Swarm: inactive
Runtimes: io.containerd.runc.v2 runc
Default Runtime: runc
Init Binary: docker-init
containerd version: 7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c
runc version: v1.1.14-0-g2c9f560
init version: de40ad0
Security Options:
apparmor
seccomp
Profile: builtin
cgroupns
Kernel Version: 6.1.100+
Operating System: Alpine Linux v3.20 (containerized)
OSType: linux
Architecture: x86_64
CPUs: 8
Total Memory: 31.35GiB
Name: cache-jtzdl-runner-z46rc
ID: 16b5115b-2001-4016-b67d-2cee2703ee86
Docker Root Dir: /var/lib/docker
Debug Mode: false
Experimental: false
Insecure Registries:
127.0.0.0/8
Live Restore Enabled: false
Product License: Community Engine
lmk if I missed any info
crazy-max
commented
1 week ago buildx-version:
/usr/bin/docker buildx version github.com/docker/buildx v0.16.2 99dea6dacacc3d604788953088560b9880550570
Looking at builder info, I guess you're using https://github.com/docker/setup-buildx-action in your workflow. Can you add version: latest to it so it downloads latest Buildx stable? (current v0.18.0):
-
name: Set up Docker Buildx
uses: docker/setup-buildx-action@v3
with:
version: latestKernel Version: 6.1.100+ Operating System: Alpine Linux v3.20 (containerized)
Looking at the os in docker info, I guess you're on a self-hosted runner?
Can you show the full YAML workflow please?
erez-levi
commented
1 week ago name: 'build_docker_push'
description: 'build a docker image from code and push it to registry'
inputs:
image_path:
description: 'path of the dockerfile in git'
required: false
default: '.'
local_runner:
description: 'use local runner'
required: false
default: 'false'
image_name:
description: 'Image name'
required: false
default: ''
use_hash:
description: 'use commit hash as the image tag'
required: false
default: 'false'
use_release:
description: 'use the tag of the latest release'
required: false
default: 'false'
image_tag:
description: 'Image tag'
required: false
default: ''
buildx:
description: 'if you want to setup the buildx'
required: false
default: 'true'
bot_token:
description: 'bot token'
required: false
default: ''
pypi_reader:
description: 'package creds'
required: false
default: ''
target:
description: 'target name'
required: false
default: ''
load:
description: 'if you want to build the action and load it without pushing'
required: false
default: 'true'
branch:
description: 'branch name'
required: false
default: 'master'
args:
description: 'args'
required: false
default: ''
checkout:
description: 'Do you want to checkout'
required: false
default: 'true'
dockerfile_name:
description: 'dockerfile name is different'
required: false
default: 'Dockerfile'
ref_to_checkout:
description: 'git ref to checkout, defaults to main'
required: false
default: ''
checkout_submodule:
description: 'use in case you want to also checkout submodules (true, false, recursive)'
required: false
default: 'false'
push_image:
description: 'whether to push the image to the registry (true or false, default is true)'
required: false
default: 'true'
image_tag_latest:
description: 'use latest tag in conjunction with the image_tag'
required: false
default: 'false'
runs:
using: "composite"
steps:
- uses: 'actions/checkout@v3'
if: ${{ inputs.checkout == 'true' }}
with:
ref: ${{ inputs.ref_to_checkout }}
fetch-depth: 0
lfs: true
submodules: ${{ inputs.checkout_submodule }}
token: ${{ env.GITHUB_TOKEN }}
- name: Set up QEMU
uses: docker/setup-qemu-action@v2
- name: Set up Docker Buildx
continue-on-error: true
uses: docker/setup-buildx-action@v3.0.0
- name: Set up docker cache
if: ${{ inputs.local_runner == 'true' }}
shell: bash
run: |
sudo mkdir -p /var/lib/docker/${{ env.NAME }}/.buildx-cache
sudo mkdir -p /var/lib/docker/${{ env.NAME }}/.buildx-cache-new
sudo chmod 777 /var/lib/docker/${{ env.NAME }}/.buildx-cache-new
- id: 'auth'
name: 'Authenticate to Google Cloud'
uses: 'google-github-actions/auth@v2'
with:
token_format: 'access_token'
workload_identity_provider: ...
service_account: '...
- name: Login to GCR
uses: docker/login-action@v2
with:
registry: gcr.io
username: oauth2accesstoken
password: ${{ steps.auth.outputs.access_token }}
- name: Set cache settings
shell: bash
run: |
if [[ "${{ inputs.local_runner }}" == "true" ]]; then
echo "CACHE_FROM=type=local,src=/var/lib/docker/${{ env.NAME }}/.buildx-cache" >> $GITHUB_ENV
echo "CACHE_TO=type=local,dest=/var/lib/docker/${{ env.NAME }}/.buildx-cache-new,mode=max" >> $GITHUB_ENV
else
echo "CACHE_FROM=type=gha" >> $GITHUB_ENV
echo "CACHE_TO=type=gha,mode=max" >> $GITHUB_ENV
fi
- name: Build image
uses: docker/build-push-action@v6
with:
push: ${{ inputs.push_image }}
context: ./${{ inputs.image_path }}
load: ${{ inputs.load }}
provenance: false
tags: |
${{ inputs.docker_repo }}/${{ env.NAME }}:rc-${{ env.TAG }}
build-args: |
GIT_BRANCH=${{ inputs.branch }}
GIT_REPO=${{ github.repository }}
GIT_TAG=${{ env.TAG }}
${{ inputs.args }}
target: ${{ inputs.target }}
shm-size: 4g
file: ./${{ inputs.image_path }}/${{ inputs.dockerfile_name }}
secret-files: |
"pip-conf=${{ env.PYPI_HOME }}/.pip/pip.conf"
"netrc=${{ env.PYPI_HOME }}/.netrc"
cache-from: ${{ env.CACHE_FROM }}
cache-to: ${{ env.CACHE_TO }}
- name: 'Set up Cloud SDK'
uses: 'google-github-actions/setup-gcloud@v2'
with:
version: '>= 363.0.0'
# Temp fix
# https://github.com/docker/build-push-action/issues/252
# https://github.com/moby/buildkit/issues/1896
- name: Move cache
if: ${{ inputs.local_runner == 'true' }}
shell: bash
run: |
sudo rm -rf /var/lib/docker/${{ env.NAME }}/.buildx-cache
sudo mv /var/lib/docker/${{ env.NAME }}/.buildx-cache-new /var/lib/docker/${{ env.NAME }}/.buildx-cache
- name: error-handle
if: ${{ failure() && steps.tag-exists.conclusion != 'failure' }}
uses: dev-drprasad/delete-tag-and-release@v0.2.1
with:
delete_release: false
tag_name: ${{ env.TAG }}
- name: error-handle for latest tag
if: ${{ inputs.image_tag_latest == 'true' }}
uses: dev-drprasad/delete-tag-and-release@v0.2.1
with:
delete_release: false
tag_name: latestits a self hosted runner indeed, we use arc for that
tuxillo
commented
1 week ago Same here, we are using ARC and we're hitting this issue too.
tri-bao
commented
1 week ago Using hosted runners and got the same issue
crazy-max
commented
1 week ago @tri-bao Do you have a link to your repo please?
tri-bao
commented
1 week ago @crazy-max We can't share the link. It's a private repo of an org
erikburt
commented
1 week ago Error from our public repo: https://github.com/smartcontractkit/chainlink/actions/runs/11823026225/job/32941422115
ERROR: failed to solve: Internal: rpc error: code = Internal desc = received 4294967290-bytes data exceeding the limit 786732 bytesThis has been fixed in https://github.com/moby/buildkit/pull/5530, will be available in next patch release of BuildKit.
crazy-max
commented
4 days ago Should be fixed with latest BuildKit stable (0.17.2)
tri-bao
commented
4 days ago Should be fixed with latest BuildKit stable (0.17.2)
Thanks @crazy-max To use this version on Github action, do we need to await for the new version of docker/setup-buildx-action action or we can use docker/setup-buildx-action@v3 and tell it to use this buildkit version?
crazy-max
commented
4 days ago Should be fixed with latest BuildKit stable (0.17.2)
Thanks @crazy-max To use this version on Github action, do we need to await for the new version of
docker/setup-buildx-actionaction or we can usedocker/setup-buildx-action@v3and tell it to use this buildkit version?
Yes latest image has been updated so no changes required in the setup-buildx-action step.
You can look at Builder info group output to make sure of it like: https://github.com/docker/build-push-action/actions/runs/11975119937/job/33387774802#step:4:125
Contributing guidelines
I've found a bug, and:
Description
Starting to encounter this issue when running the action:
Error: buildx failed with: ERROR: failed to solve: Internal: rpc error: code = Internal desc = received 4294967293-bytes data exceeding the limit 491994 bytesIt started after I added the load: true parameter to my action but I didn't manage to reproduce it to know if that is indeed what triggered it, when it fails a rerun is always successful afterwards which isn't expected.
Expected behaviour
Build should run smoothly without this error
Actual behaviour
Getting this error in the beginning of the docker build:
Error: buildx failed with: ERROR: failed to solve: Internal: rpc error: code = Internal desc = received 4294967293-bytes data exceeding the limit 491994 bytesWhen rerunning it the build is successful
Repository URL
No response
Workflow run URL
No response
YAML workflow
Workflow logs
BuildKit logs
Additional info
buildkit-4.txt buildkit-3.txt buildkit-5.txt buildkit-2txt.txt buildkit-1.txt