aws / aws-codebuild-docker-images

Official AWS CodeBuild repository for managed Docker images http://docs.aws.amazon.com/codebuild/latest/userguide/build-env-ref.html
Other
1.12k stars 977 forks source link

Bottlerocket build is not working in codebuild because of docker configurations #730

Open NaomiLYJ opened 3 months ago

NaomiLYJ commented 3 months ago

I'm trying to build bottlerocket with the instructions .

It requires buildkit and containerd-snapshotter to be enabled.

{
    "features": {
        "buildkit": true,
        "containerd-snapshotter": true
    }
}

But configurations are not working with error:

[Container] 2024/07/29 14:49:32.979103 Running command tail -n 100 /var/log/docker.log
time="2024-07-29T14:49:28.162837366Z" level=info msg="Starting up"
time="2024-07-29T14:49:28.163156934Z" level=warning msg="Binding to IP address without --tlsverify is insecure and gives root access on this machine to everyone who has access to your network." host="tcp://127.0.0.1:2375"
time="2024-07-29T14:49:28.163171925Z" level=warning msg="Binding to an IP address, even on localhost, can also give access to scripts run in a browser. Be safe out there!" host="tcp://127.0.0.1:2375"
time="2024-07-29T14:49:29.164443006Z" level=warning msg="could not change group /var/run/docker.sock to docker: group docker not found"
time="2024-07-29T14:49:29.165163973Z" level=info msg="libcontainerd: started new containerd process" pid=323
time="2024-07-29T14:49:29.180643509Z" level=info msg="starting containerd" revision=3dce8eb055cbb6872793272b4f20ed16117344f8 version=v1.6.21
time="2024-07-29T14:49:29.194622976Z" level=info msg="loading plugin \"io.containerd.content.v1.content\"..." type=io.containerd.content.v1
time="2024-07-29T14:49:29.194672545Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.aufs\"..." type=io.containerd.snapshotter.v1
time="2024-07-29T14:49:29.196220864Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.aufs\"..." error="aufs is not supported (modprobe aufs failed: exit status 1 \"modprobe: FATAL: Module aufs not found in directory /lib/modules/4.14.291-218.527.amzn2.x86_64\\n\"): skip plugin" type=io.containerd.snapshotter.v1
time="2024-07-29T14:49:29.196320287Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.devmapper\"..." type=io.containerd.snapshotter.v1
time="2024-07-29T14:49:29.196341412Z" level=warning msg="failed to load plugin io.containerd.snapshotter.v1.devmapper" error="devmapper not configured"
time="2024-07-29T14:49:29.196356956Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.native\"..." type=io.containerd.snapshotter.v1
time="2024-07-29T14:49:29.196391349Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.overlayfs\"..." type=io.containerd.snapshotter.v1
time="2024-07-29T14:49:29.196500689Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.zfs\"..." type=io.containerd.snapshotter.v1
time="2024-07-29T14:49:29.196710244Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.zfs\"..." error="path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.zfs must be a zfs filesystem to be used with the zfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1
time="2024-07-29T14:49:29.196725567Z" level=info msg="loading plugin \"io.containerd.metadata.v1.bolt\"..." type=io.containerd.metadata.v1
time="2024-07-29T14:49:29.196740808Z" level=warning msg="could not use snapshotter devmapper in metadata plugin" error="devmapper not configured"
time="2024-07-29T14:49:29.196749846Z" level=info msg="metadata content store policy set" policy=shared
time="2024-07-29T14:49:29.196828429Z" level=info msg="loading plugin \"io.containerd.differ.v1.walking\"..." type=io.containerd.differ.v1
time="2024-07-29T14:49:29.196850609Z" level=info msg="loading plugin \"io.containerd.event.v1.exchange\"..." type=io.containerd.event.v1
time="2024-07-29T14:49:29.196867154Z" level=info msg="loading plugin \"io.containerd.gc.v1.scheduler\"..." type=io.containerd.gc.v1
time="2024-07-29T14:49:29.197174347Z" level=info msg="loading plugin \"io.containerd.service.v1.introspection-service\"..." type=io.containerd.service.v1
time="2024-07-29T14:49:29.197235189Z" level=info msg="loading plugin \"io.containerd.service.v1.containers-service\"..." type=io.containerd.service.v1
time="2024-07-29T14:49:29.197267921Z" level=info msg="loading plugin \"io.containerd.service.v1.content-service\"..." type=io.containerd.service.v1
time="2024-07-29T14:49:29.197421367Z" level=info msg="loading plugin \"io.containerd.service.v1.diff-service\"..." type=io.containerd.service.v1
time="2024-07-29T14:49:29.197457292Z" level=info msg="loading plugin \"io.containerd.service.v1.images-service\"..." type=io.containerd.service.v1
time="2024-07-29T14:49:29.197482311Z" level=info msg="loading plugin \"io.containerd.service.v1.leases-service\"..." type=io.containerd.service.v1
time="2024-07-29T14:49:29.197514454Z" level=info msg="loading plugin \"io.containerd.service.v1.namespaces-service\"..." type=io.containerd.service.v1
time="2024-07-29T14:49:29.197548863Z" level=info msg="loading plugin \"io.containerd.service.v1.snapshots-service\"..." type=io.containerd.service.v1
time="2024-07-29T14:49:29.197572837Z" level=info msg="loading plugin \"io.containerd.runtime.v1.linux\"..." type=io.containerd.runtime.v1
time="2024-07-29T14:49:29.197637183Z" level=info msg="loading plugin \"io.containerd.runtime.v2.task\"..." type=io.containerd.runtime.v2
time="2024-07-29T14:49:29.197697708Z" level=info msg="loading plugin \"io.containerd.monitor.v1.cgroups\"..." type=io.containerd.monitor.v1
time="2024-07-29T14:49:29.198198275Z" level=info msg="loading plugin \"io.containerd.service.v1.tasks-service\"..." type=io.containerd.service.v1
time="2024-07-29T14:49:29.198241955Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1
time="2024-07-29T14:49:29.198279157Z" level=info msg="loading plugin \"io.containerd.internal.v1.restart\"..." type=io.containerd.internal.v1
time="2024-07-29T14:49:29.198340272Z" level=info msg="loading plugin \"io.containerd.grpc.v1.containers\"..." type=io.containerd.grpc.v1
time="2024-07-29T14:49:29.198355901Z" level=info msg="loading plugin \"io.containerd.grpc.v1.content\"..." type=io.containerd.grpc.v1
time="2024-07-29T14:49:29.198369445Z" level=info msg="loading plugin \"io.containerd.grpc.v1.diff\"..." type=io.containerd.grpc.v1
time="2024-07-29T14:49:29.198381902Z" level=info msg="loading plugin \"io.containerd.grpc.v1.events\"..." type=io.containerd.grpc.v1
time="2024-07-29T14:49:29.198396578Z" level=info msg="loading plugin \"io.containerd.grpc.v1.healthcheck\"..." type=io.containerd.grpc.v1
time="2024-07-29T14:49:29.198410123Z" level=info msg="loading plugin \"io.containerd.grpc.v1.images\"..." type=io.containerd.grpc.v1
time="2024-07-29T14:49:29.198422725Z" level=info msg="loading plugin \"io.containerd.grpc.v1.leases\"..." type=io.containerd.grpc.v1
time="2024-07-29T14:49:29.198435319Z" level=info msg="loading plugin \"io.containerd.grpc.v1.namespaces\"..." type=io.containerd.grpc.v1
time="2024-07-29T14:49:29.198453475Z" level=info msg="loading plugin \"io.containerd.internal.v1.opt\"..." type=io.containerd.internal.v1
time="2024-07-29T14:49:29.198526755Z" level=info msg="loading plugin \"io.containerd.grpc.v1.snapshots\"..." type=io.containerd.grpc.v1
time="2024-07-29T14:49:29.198541329Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1
time="2024-07-29T14:49:29.198555006Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1
time="2024-07-29T14:49:29.198567955Z" level=info msg="loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." type=io.containerd.tracing.processor.v1
time="2024-07-29T14:49:29.198584316Z" level=info msg="skip loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." error="no OpenTelemetry endpoint: skip plugin" type=io.containerd.tracing.processor.v1
time="2024-07-29T14:49:29.198607201Z" level=info msg="loading plugin \"io.containerd.internal.v1.tracing\"..." type=io.containerd.internal.v1
time="2024-07-29T14:49:29.198627027Z" level=error msg="failed to initialize a tracing processor \"otlp\"" error="no OpenTelemetry endpoint: skip plugin"
time="2024-07-29T14:49:29.198837193Z" level=info msg=serving... address=/var/run/docker/containerd/containerd-debug.sock
time="2024-07-29T14:49:29.198913306Z" level=info msg=serving... address=/var/run/docker/containerd/containerd.sock.ttrpc
time="2024-07-29T14:49:29.198956201Z" level=info msg=serving... address=/var/run/docker/containerd/containerd.sock
time="2024-07-29T14:49:29.199182936Z" level=info msg="containerd successfully booted in 0.019502s"
time="2024-07-29T14:49:29.215814061Z" level=info msg="[graphdriver] trying configured driver: overlay2"
time="2024-07-29T14:49:29.517771681Z" level=info msg="Loading containers: start."
time="2024-07-29T14:49:29.519355148Z" level=warning msg="Running modprobe bridge br_netfilter failed with message: modprobe: WARNING: Module bridge not found in directory /lib/modules/4.14.291-218.527.amzn2.x86_64\nmodprobe: WARNING: Module br_netfilter not found in directory /lib/modules/4.14.291-218.527.amzn2.x86_64\n, error: exit status 1"
time="2024-07-29T14:49:31.766159803Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.18.0.0/16. Daemon option --bip can be used to set a preferred IP address"
time="2024-07-29T14:49:32.797585441Z" level=info msg="Loading containers: done."
time="2024-07-29T14:49:32.843855155Z" level=warning msg="WARNING: API is accessible on http://127.0.0.1:2375 without encryption.\n         Access to the remote API is equivalent to root access on the host. Refer\n         to the 'Docker daemon attack surface' section in the documentation for\n         more information: https://docs.docker.com/go/attack-surface/"
time="2024-07-29T14:49:32.843892545Z" level=warning msg="WARNING: bridge-nf-call-iptables is disabled"
time="2024-07-29T14:49:32.843899913Z" level=warning msg="WARNING: bridge-nf-call-ip6tables is disabled"
time="2024-07-29T14:49:32.843928968Z" level=info msg="Docker daemon" commit=9dbdbd4 graphdriver=overlay2 version=23.0.6
time="2024-07-29T14:49:32.843970229Z" level=info msg="Daemon has completed initialization"
time="2024-07-29T14:49:32.871712571Z" level=info msg="API listen on 127.0.0.1:2375"
time="2024-07-29T14:49:32.878801687Z" level=info msg="API listen on /var/run/docker.sock"

The storage driver info is still

 Storage Driver: overlay2
  Backing Filesystem: xfs
  Supports d_type: true
  Using metacopy: false
  Native Overlay Diff: true
  userxattr: false

But the expected configuration is

Storage Driver: overlay2
  driver-type: io.containerd.snapshotter.v1

It would be great if someone could help here

NaomiLYJ commented 3 months ago

Managed to configure docker with dind image from https://github.com/cruizba/ubuntu-dind/tree/master. But none of the aws codebuild managed image work.