search

containers / buildah

A tool that facilitates building OCI images.
https://buildah.io
Apache License 2.0
7.35k stars 776 forks source link

buildah build fails with error committing container for step "X": error copying layers and metadata for container "<CONTAINERHASH>": Error initializing source containers-storage:127.0.0.1-working-container-729: error extracting layer "<LAYERHASH>": no such file or directory #2521

Closed mwhahaha closed 3 years ago

mwhahaha commented 4 years ago

Description

Similar error message as #2161. We're seeing this when running a few "buildah bud" instances in parallel. It is not consistent between containers being built. Error is not ending up in the log file but being printed to stderr of the buildah command.

We're also seeing this on rhel 8.3.0 with the same versions and 1.14.x versions. We don't have the same issue with 1.11.x versions using the exact same processes.

Command: sudo buildah --debug bud --volume /etc/yum.repos.d:/etc/yum.repos.d:z --volume /etc/pki/rpm-gpg:/etc/pki/rpm-gpg:z --volume /home/centos/repos:/etc/yum.repos.d:z --volume /etc/pki/rpm-gpg:/etc/pki/rpm-gpg:z --format docker --tls-verify=False --logfile /tmp/container-builds/c37315ef-31f6-48fb-8534-0b66da489d48/base/os/ceilometer-base/ceilometer-central/ceilometer-central-build.log -t 127.0.0.1:5555/tripleomaster/openstack-ceilometer-central:latest-2020-08-07_19-35-07 /tmp/container-builds/c37315ef-31f6-48fb-8534-0b66da489d48/base/os/ceilometer-base/ceilometer-central Exit code: 125 Stdout: '' Stderr: 'level=debug msg="Pull Policy for pull [PullIfNewer]"\nerror committing container for step {Env:[PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin LANG=en_US.UTF-8 container=oci] Command:user Args:[ceilometer] Flags:[] Attrs:map[] Message:USER ceilometer Original:USER ceilometer}: error copying layers and metadata for container "a945de1513214af498237f0d209fea047e44d1bcdbbbd63f48514d3b9e7f37be": Error initializing source containers-storage:127.0.0.1-working-container-729: error extracting layer "d479d05fece5300915b192c28ea04540ea43e93a0a9cc298c48dee46814161c1": no such file or directory\n'

Steps to reproduce the issue:

  1. run several buildah bud in parallel
  2. occasional failure trying to copy layers

Describe the results you received: Randomly fails when processing a layer

Describe the results you expected: No failures

Output of rpm -q buildah or apt list buildah:

[centos@undercloud ~]$ rpm -q buildah
buildah-1.15.0-1.module_el8.3.0+432+2e9cbcd8.x86_64

Output of buildah version:

buildah --version
buildah version 1.15.0 (image-spec 1.0.1-dev, runtime-spec 1.0.2-dev)

*Output of `cat /etc/release`:**

[centos@undercloud ~]$ cat /etc/*release*
CentOS Linux release 8.2.2004 (Core) 
Derived from Red Hat Enterprise Linux 8.2 (Source)
NAME="CentOS Linux"
VERSION="8 (Core)"
ID="centos"
ID_LIKE="rhel fedora"
VERSION_ID="8"
PLATFORM_ID="platform:el8"
PRETTY_NAME="CentOS Linux 8 (Core)"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:centos:centos:8"
HOME_URL="https://www.centos.org/"
BUG_REPORT_URL="https://bugs.centos.org/"

CENTOS_MANTISBT_PROJECT="CentOS-8"
CENTOS_MANTISBT_PROJECT_VERSION="8"
REDHAT_SUPPORT_PRODUCT="centos"
REDHAT_SUPPORT_PRODUCT_VERSION="8"

CentOS Linux release 8.2.2004 (Core) 
CentOS Linux release 8.2.2004 (Core) 
cpe:/o:centos:centos:8

Output of uname -a:

uname -a
Linux undercloud.localdomain 4.18.0-227.el8.x86_64 #1 SMP Tue Jul 28 22:53:29 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Output of cat /etc/containers/storage.conf:

# This file is is the configuration file for all tools
# that use the containers/storage library.
# See man 5 containers-storage.conf for more information
# The "container storage" table contains all of the server options.
[storage]

# Default Storage Driver
driver = "overlay"

# Temporary storage location
runroot = "/var/run/containers/storage"

# Primary Read/Write location of container storage
graphroot = "/var/lib/containers/storage"

# Storage path for rootless users
#
# rootless_storage_path = "$HOME/.local/share/containers/storage"

[storage.options]
# Storage options to be passed to underlying storage drivers

# AdditionalImageStores is used to pass paths to additional Read/Only image stores
# Must be comma separated list.
additionalimagestores = [
]

# Remap-UIDs/GIDs is the mapping from UIDs/GIDs as they should appear inside of
# a container, to the UIDs/GIDs as they should appear outside of the container,
# and the length of the range of UIDs/GIDs.  Additional mapped sets can be
# listed and will be heeded by libraries, but there are limits to the number of
# mappings which the kernel will allow when you later attempt to run a
# container.
#
# remap-uids = 0:1668442479:65536
# remap-gids = 0:1668442479:65536

# Remap-User/Group is a user name which can be used to look up one or more UID/GID
# ranges in the /etc/subuid or /etc/subgid file.  Mappings are set up starting
# with an in-container ID of 0 and then a host-level ID taken from the lowest
# range that matches the specified name, and using the length of that range.
# Additional ranges are then assigned, using the ranges which specify the
# lowest host-level IDs first, to the lowest not-yet-mapped in-container ID,
# until all of the entries have been used for maps.
#
# remap-user = "containers"
# remap-group = "containers"

# Root-auto-userns-user is a user name which can be used to look up one or more UID/GID
# ranges in the /etc/subuid and /etc/subgid file.  These ranges will be partioned
# to containers configured to create automatically a user namespace.  Containers
# configured to automatically create a user namespace can still overlap with containers
# having an explicit mapping set.
# This setting is ignored when running as rootless.
# root-auto-userns-user = "storage"
#
# Auto-userns-min-size is the minimum size for a user namespace created automatically.
# auto-userns-min-size=1024
#
# Auto-userns-max-size is the minimum size for a user namespace created automatically.
# auto-userns-max-size=65536

[storage.options.overlay]
# ignore_chown_errors can be set to allow a non privileged user running with
# a single UID within a user namespace to run containers. The user can pull
# and use any image even those with multiple uids.  Note multiple UIDs will be
# squashed down to the default uid in the container.  These images will have no
# separation between the users in the container. Only supported for the overlay
# and vfs drivers.
#ignore_chown_errors = false

# Path to an helper program to use for mounting the file system instead of mounting it
# directly.
#mount_program = "/usr/bin/fuse-overlayfs"

# mountopt specifies comma separated list of extra mount options
mountopt = "nodev,metacopy=on"

# Size is used to set a maximum size of the container image.
# size = ""

[storage.options.thinpool]
# Storage Options for thinpool

# autoextend_percent determines the amount by which pool needs to be
# grown. This is specified in terms of % of pool size. So a value of 20 means
# that when threshold is hit, pool will be grown by 20% of existing
# pool size.
# autoextend_percent = "20"

# autoextend_threshold determines the pool extension threshold in terms
# of percentage of pool size. For example, if threshold is 60, that means when
# pool is 60% full, threshold has been hit.
# autoextend_threshold = "80"

# basesize specifies the size to use when creating the base device, which
# limits the size of images and containers.
# basesize = "10G"

# blocksize specifies a custom blocksize to use for the thin pool.
# blocksize="64k"

# directlvm_device specifies a custom block storage device to use for the
# thin pool. Required if you setup devicemapper.
# directlvm_device = ""

# directlvm_device_force wipes device even if device already has a filesystem.
# directlvm_device_force = "True"

# fs specifies the filesystem type to use for the base device.
# fs="xfs"

# log_level sets the log level of devicemapper.
# 0: LogLevelSuppress 0 (Default)
# 2: LogLevelFatal
# 3: LogLevelErr
# 4: LogLevelWarn
# 5: LogLevelNotice
# 6: LogLevelInfo
# 7: LogLevelDebug
# log_level = "7"

# min_free_space specifies the min free space percent in a thin pool require for
# new device creation to succeed. Valid values are from 0% - 99%.
# Value 0% disables
# min_free_space = "10%"

# mkfsarg specifies extra mkfs arguments to be used when creating the base
# device.
# mkfsarg = ""

# Size is used to set a maximum size of the container image.
# size = ""

# use_deferred_removal marks devicemapper block device for deferred removal.
# If the thinpool is in use when the driver attempts to remove it, the driver
# tells the kernel to remove it as soon as possible. Note this does not free
# up the disk space, use deferred deletion to fully remove the thinpool.
# use_deferred_removal = "True"

# use_deferred_deletion marks thinpool device for deferred deletion.
# If the device is busy when the driver attempts to delete it, the driver
# will attempt to delete device every 30 seconds until successful.
# If the program using the driver exits, the driver will continue attempting
# to cleanup the next time the driver is used. Deferred deletion permanently
# deletes the device and all data stored in device will be lost.
# use_deferred_deletion = "True"

# xfs_nospace_max_retries specifies the maximum number of retries XFS should
# attempt to complete IO when ENOSPC (no space) error is returned by
# underlying storage device.
# xfs_nospace_max_retries = "0"
mwhahaha commented 4 years ago

Contents of /tmp/container-builds/c37315ef-31f6-48fb-8534-0b66da489d48/base/os/ceilometer-base/ceilometer-central/ceilometer-central-build.log

level=debug msg="[graphdriver] trying provided driver \"overlay\""
level=debug msg="cached value indicated that overlay is supported"
level=debug msg="cached value indicated that metacopy is being used"
level=debug msg="cached value indicated that native-diff is not being used"
level=warning msg="Not using native diff for overlay, this may cause degraded performance for building images: kernel has CONFIG_OVERLAY_FS_REDIRECT_DIR enabled"
level=debug msg="backingFs=xfs, projectQuotaSupported=false, useNativeDiff=false, usingMetacopy=true"
level=debug msg="reading local Dockerfile \"/tmp/container-builds/c37315ef-31f6-48fb-8534-0b66da489d48/base/os/ceilometer-base/ceilometer-central/Dockerfile\""
level=debug msg="base: \"127.0.0.1:5555/tripleomaster/openstack-ceilometer-base:latest-2020-08-07_19-35-07\""
level=debug msg="FROM \"127.0.0.1:5555/tripleomaster/openstack-ceilometer-base:latest-2020-08-07_19-35-07\""
STEP 1: FROM 127.0.0.1:5555/tripleomaster/openstack-ceilometer-base:latest-2020-08-07_19-35-07
level=debug msg="parsed reference into \"[overlay@/var/lib/containers/storage+/var/run/containers/storage:overlay.mountopt=nodev,metacopy=on]127.0.0.1:5555/tripleomaster/openstack-ceilometer-base:latest-2020-08-07_19-35-07\""
level=debug msg="parsed reference into \"[overlay@/var/lib/containers/storage+/var/run/containers/storage:overlay.mountopt=nodev,metacopy=on]127.0.0.1:5555/tripleomaster/openstack-ceilometer-base:latest-2020-08-07_19-35-07\""
level=debug msg="Loading registries configuration \"/etc/containers/registries.conf\""
level=debug msg="Trying to access \"127.0.0.1:5555/tripleomaster/openstack-ceilometer-base:latest-2020-08-07_19-35-07\""
level=debug msg="Credentials not found"
level=debug msg="Using registries.d directory /etc/containers/registries.d for sigstore configuration"
level=debug msg=" Using \"default-docker\" configuration"
level=debug msg=" No signature storage configuration found for 127.0.0.1:5555/tripleomaster/openstack-ceilometer-base:latest-2020-08-07_19-35-07"
level=debug msg="Looking for TLS certificates and private keys in /etc/docker/certs.d/127.0.0.1:5555"
level=debug msg="GET https://127.0.0.1:5555/v2/"
level=debug msg="Ping https://127.0.0.1:5555/v2/ err Get https://127.0.0.1:5555/v2/: http: server gave HTTP response to HTTPS client (&url.Error{Op:\"Get\", URL:\"https://127.0.0.1:5555/v2/\", Err:(*errors.errorString)(0xc00044c880)})"
level=debug msg="GET http://127.0.0.1:5555/v2/"
level=debug msg="Ping http://127.0.0.1:5555/v2/ status 200"
level=debug msg="GET http://127.0.0.1:5555/v2/tripleomaster/openstack-ceilometer-base/manifests/latest-2020-08-07_19-35-07"
level=debug msg="Content-Type from manifest GET is \"application/vnd.docker.distribution.manifest.v2+json\""
level=debug msg="Downloading /v2/tripleomaster/openstack-ceilometer-base/blobs/sha256:de145ab98f4771fa2f60fd8ad7e6972b38f109c0a08395efd23288365fc182b4"
level=debug msg="GET http://127.0.0.1:5555/v2/tripleomaster/openstack-ceilometer-base/blobs/sha256:de145ab98f4771fa2f60fd8ad7e6972b38f109c0a08395efd23288365fc182b4"
level=debug msg="exporting opaque data as blob \"sha256:de145ab98f4771fa2f60fd8ad7e6972b38f109c0a08395efd23288365fc182b4\""
level=debug msg="overlay: mount_data=nodev,metacopy=on,lowerdir=/var/lib/containers/storage/overlay/l/OEMKI2CZVB4KVIPYMEH3F5T7KH:/var/lib/containers/storage/overlay/l/HWAZ7PTSMOFWCMSF7HRPODBVQZ:/var/lib/containers/storage/overlay/l/LT6QQHACUS5V45YKZRUSAN4GYW:/var/lib/containers/storage/overlay/l/LZTQOQFJS7MJ5PT6DP2YOJJVGB:/var/lib/containers/storage/overlay/l/QM2XADMP2FIPDGN5GBXDP4E36W,upperdir=/var/lib/containers/storage/overlay/d479d05fece5300915b192c28ea04540ea43e93a0a9cc298c48dee46814161c1/diff,workdir=/var/lib/containers/storage/overlay/d479d05fece5300915b192c28ea04540ea43e93a0a9cc298c48dee46814161c1/work,context=\"system_u:object_r:container_file_t:s0:c306,c684\""
level=debug msg="Container ID: a945de1513214af498237f0d209fea047e44d1bcdbbbd63f48514d3b9e7f37be"
level=debug msg="Parsed Step: {Env:[PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin LANG=en_US.UTF-8 container=oci] Command:run Args:[if [ 'centos' == 'rhel' ]; then dnf module -y disable virt:rhel; dnf module -y enable virt:8.2; fi] Flags:[] Attrs:map[] Message:RUN if [ 'centos' == 'rhel' ]; then dnf module -y disable virt:rhel; dnf module -y enable virt:8.2; fi Original:RUN if [ 'centos' == 'rhel' ]; then dnf module -y disable virt:rhel; dnf module -y enable virt:8.2; fi}"
STEP 2: RUN if [ 'centos' == 'rhel' ]; then dnf module -y disable virt:rhel; dnf module -y enable virt:8.2; fi
level=debug msg="RUN imagebuilder.Run{Shell:true, Args:[]string{\"if [ 'centos' == 'rhel' ]; then dnf module -y disable virt:rhel; dnf module -y enable virt:8.2; fi\"}}, docker.Config{Hostname:\"eba898107bd8\", Domainname:\"\", User:\"\", Memory:0, MemorySwap:0, MemoryReservation:0, KernelMemory:0, CPUShares:0, CPUSet:\"\", PortSpecs:[]string(nil), ExposedPorts:map[docker.Port]struct {}{}, PublishService:\"\", StopSignal:\"SIGTERM\", StopTimeout:0, Env:[]string{\"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin\", \"LANG=en_US.UTF-8\", \"container=oci\"}, Cmd:[]string{\"kolla_start\"}, Shell:[]string{}, Healthcheck:(*docker.HealthConfig)(nil), DNS:[]string(nil), Image:\"\", Volumes:map[string]struct {}{}, VolumeDriver:\"\", WorkingDir:\"\", MacAddress:\"\", Entrypoint:[]string{\"dumb-init\", \"--single-child\", \"--\"}, SecurityOpts:[]string(nil), OnBuild:[]string{}, Mounts:[]docker.Mount(nil), Labels:map[string]string{\"architecture\":\"x86_64\", \"build-date\":\"2020-07-22T12:11:33.547097\", \"com.redhat.build-host\":\"cpt-1007.osbs.prod.upshift.rdu2.redhat.com\", \"com.redhat.component\":\"ubi8-container\", \"com.redhat.license_terms\":\"https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI\", \"description\":\"The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.\", \"distribution-scope\":\"public\", \"io.k8s.description\":\"The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.\", \"io.k8s.display-name\":\"Red Hat Universal Base Image 8\", \"io.openshift.expose-services\":\"\", \"io.openshift.tags\":\"base rhel8\", \"kolla_version\":\"none\", \"maintainer\":\"OpenStack TripleO team\", \"name\":\"ubi8\", \"release\":\"343\", \"summary\":\"Provides the latest release of Red Hat Universal Base Image 8.\", \"url\":\"https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.2-343\", \"vcs-ref\":\"0fede9a6ae85a36962206913c66bfe9965c49940\", \"vcs-type\":\"git\", \"vendor\":\"Red Hat, Inc.\", \"version\":\"8.2\"}, AttachStdin:false, AttachStdout:false, AttachStderr:false, ArgsEscaped:false, Tty:false, OpenStdin:false, StdinOnce:false, NetworkDisabled:false, VolumesFrom:\"\"}"
level=debug msg="using \"/var/tmp/buildah828050619\" to hold bundle data"
level=debug msg="Resources: &buildah.CommonBuildOptions{AddHost:[]string{}, CgroupParent:\"\", CPUPeriod:0x0, CPUQuota:0, CPUShares:0x0, CPUSetCPUs:\"\", CPUSetMems:\"\", HTTPProxy:true, Memory:0, DNSSearch:[]string{}, DNSServers:[]string{}, DNSOptions:[]string{}, MemorySwap:0, LabelOpts:[]string(nil), SeccompProfilePath:\"/usr/share/containers/seccomp.json\", ApparmorProfile:\"\", ShmSize:\"65536k\", Ulimit:[]string{}, Volumes:[]string{\"/etc/yum.repos.d:/etc/yum.repos.d:z\", \"/etc/pki/rpm-gpg:/etc/pki/rpm-gpg:z\", \"/home/centos/repos:/etc/yum.repos.d:z\", \"/etc/pki/rpm-gpg:/etc/pki/rpm-gpg:z\"}}"
level=debug msg="stdio is not a terminal, defaulting to not using a terminal"
level=debug msg="ensuring working directory \"/var/lib/containers/storage/overlay/d479d05fece5300915b192c28ea04540ea43e93a0a9cc298c48dee46814161c1/merged\" exists"
level=debug msg="/etc/system-fips does not exist on host, not mounting FIPS mode secret"
level=debug msg="setting up mounted volume at \"/etc/pki/rpm-gpg\""
level=debug msg="setting up mounted volume at \"/etc/yum.repos.d\""
level=debug msg="setting up mounted volume at \"/etc/pki/rpm-gpg\""
level=debug msg="setting up mounted volume at \"/etc/yum.repos.d\""
level=debug msg="bind mounted \"/var/lib/containers/storage/overlay/d479d05fece5300915b192c28ea04540ea43e93a0a9cc298c48dee46814161c1/merged\" to \"/var/tmp/buildah828050619/mnt/rootfs\""
level=debug msg="bind mounted \"/etc/pki/rpm-gpg\" to \"/var/tmp/buildah828050619/mnt/buildah-bind-target-0\""
level=debug msg="bind mounted \"/home/centos/repos\" to \"/var/tmp/buildah828050619/mnt/buildah-bind-target-1\""
level=debug msg="bind mounted \"/var/lib/containers/storage/overlay-containers/a945de1513214af498237f0d209fea047e44d1bcdbbbd63f48514d3b9e7f37be/userdata/run/secrets\" to \"/var/tmp/buildah828050619/mnt/buildah-bind-target-2\""
level=debug msg="config = {\"ociVersion\":\"1.0.2-dev\",\"process\":{\"user\":{\"uid\":0,\"gid\":0},\"args\":[\"/bin/sh\",\"-c\",\"if [ 'centos' == 'rhel' ]; then dnf module -y disable virt:rhel; dnf module -y enable virt:8.2; fi\"],\"env\":[\"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin\",\"LANG=en_US.UTF-8\",\"container=oci\",\"HOSTNAME=eba898107bd8\"],\"cwd\":\"/\",\"capabilities\":{\"bounding\":[\"CAP_AUDIT_WRITE\",\"CAP_CHOWN\",\"CAP_DAC_OVERRIDE\",\"CAP_FOWNER\",\"CAP_FSETID\",\"CAP_KILL\",\"CAP_MKNOD\",\"CAP_NET_BIND_SERVICE\",\"CAP_NET_RAW\",\"CAP_SETFCAP\",\"CAP_SETGID\",\"CAP_SETPCAP\",\"CAP_SETUID\",\"CAP_SYS_CHROOT\"],\"effective\":[\"CAP_AUDIT_WRITE\",\"CAP_CHOWN\",\"CAP_DAC_OVERRIDE\",\"CAP_FOWNER\",\"CAP_FSETID\",\"CAP_KILL\",\"CAP_MKNOD\",\"CAP_NET_BIND_SERVICE\",\"CAP_NET_RAW\",\"CAP_SETFCAP\",\"CAP_SETGID\",\"CAP_SETPCAP\",\"CAP_SETUID\",\"CAP_SYS_CHROOT\"],\"inheritable\":[\"CAP_AUDIT_WRITE\",\"CAP_CHOWN\",\"CAP_DAC_OVERRIDE\",\"CAP_FOWNER\",\"CAP_FSETID\",\"CAP_KILL\",\"CAP_MKNOD\",\"CAP_NET_BIND_SERVICE\",\"CAP_NET_RAW\",\"CAP_SETFCAP\",\"CAP_SETGID\",\"CAP_SETPCAP\",\"CAP_SETUID\",\"CAP_SYS_CHROOT\"],\"permitted\":[\"CAP_AUDIT_WRITE\",\"CAP_CHOWN\",\"CAP_DAC_OVERRIDE\",\"CAP_FOWNER\",\"CAP_FSETID\",\"CAP_KILL\",\"CAP_MKNOD\",\"CAP_NET_BIND_SERVICE\",\"CAP_NET_RAW\",\"CAP_SETFCAP\",\"CAP_SETGID\",\"CAP_SETPCAP\",\"CAP_SETUID\",\"CAP_SYS_CHROOT\"],\"ambient\":[\"CAP_AUDIT_WRITE\",\"CAP_CHOWN\",\"CAP_DAC_OVERRIDE\",\"CAP_FOWNER\",\"CAP_FSETID\",\"CAP_KILL\",\"CAP_MKNOD\",\"CAP_NET_BIND_SERVICE\",\"CAP_NET_RAW\",\"CAP_SETFCAP\",\"CAP_SETGID\",\"CAP_SETPCAP\",\"CAP_SETUID\",\"CAP_SYS_CHROOT\"]},\"rlimits\":[{\"type\":\"RLIMIT_NOFILE\",\"hard\":1024,\"soft\":1024},{\"type\":\"RLIMIT_NPROC\",\"hard\":4194304,\"soft\":4194304}],\"selinuxLabel\":\"system_u:system_r:container_t:s0:c306,c684\"},\"root\":{\"path\":\"/var/tmp/buildah828050619/mnt/rootfs\"},\"hostname\":\"eba898107bd8\",\"mounts\":[{\"destination\":\"/etc/pki/rpm-gpg\",\"type\":\"bind\",\"source\":\"/var/tmp/buildah828050619/mnt/buildah-bind-target-0\",\"options\":[\"z\",\"rw\",\"private\",\"rbind\"]},{\"destination\":\"/etc/yum.repos.d\",\"type\":\"bind\",\"source\":\"/var/tmp/buildah828050619/mnt/buildah-bind-target-1\",\"options\":[\"z\",\"rw\",\"private\",\"rbind\"]},{\"destination\":\"/run/secrets\",\"type\":\"bind\",\"source\":\"/var/tmp/buildah828050619/mnt/buildah-bind-target-2\",\"options\":[\"bind\",\"rprivate\"]},{\"destination\":\"/etc/hosts\",\"type\":\"bind\",\"source\":\"/var/tmp/buildah828050619/hosts\",\"options\":[\"rbind\"]},{\"destination\":\"/etc/resolv.conf\",\"type\":\"bind\",\"source\":\"/var/tmp/buildah828050619/resolv.conf\",\"options\":[\"rbind\"]},{\"destination\":\"/run/.containerenv\",\"type\":\"bind\",\"source\":\"/var/tmp/buildah828050619/run/.containerenv\",\"options\":[\"rbind\"]},{\"destination\":\"/proc\",\"type\":\"proc\",\"source\":\"proc\",\"options\":[\"nosuid\",\"noexec\",\"nodev\"]},{\"destination\":\"/dev\",\"type\":\"tmpfs\",\"source\":\"tmpfs\",\"options\":[\"nosuid\",\"strictatime\",\"mode=755\",\"size=65536k\"]},{\"destination\":\"/dev/pts\",\"type\":\"devpts\",\"source\":\"devpts\",\"options\":[\"nosuid\",\"noexec\",\"newinstance\",\"ptmxmode=0666\",\"mode=0620\",\"gid=5\"]},{\"destination\":\"/dev/shm\",\"type\":\"tmpfs\",\"source\":\"shm\",\"options\":[\"nosuid\",\"noexec\",\"nodev\",\"mode=1777\",\"size=65536k\"]},{\"destination\":\"/dev/mqueue\",\"type\":\"mqueue\",\"source\":\"mqueue\",\"options\":[\"nosuid\",\"noexec\",\"nodev\"]},{\"destination\":\"/sys\",\"type\":\"sysfs\",\"source\":\"sysfs\",\"options\":[\"nosuid\",\"noexec\",\"nodev\",\"ro\"]},{\"destination\":\"/sys/fs/cgroup\",\"type\":\"cgroup\",\"source\":\"cgroup\",\"options\":[\"nosuid\",\"noexec\",\"nodev\",\"relatime\",\"ro\"]}],\"linux\":{\"resources\":{\"devices\":[{\"allow\":false,\"access\":\"rwm\"}]},\"namespaces\":[{\"type\":\"pid\"},{\"type\":\"ipc\"},{\"type\":\"uts\"},{\"type\":\"mount\"}],\"seccomp\":{\"defaultAction\":\"SCMP_ACT_ERRNO\",\"architectures\":[\"SCMP_ARCH_X86_64\",\"SCMP_ARCH_X86\",\"SCMP_ARCH_X32\"],\"syscalls\":[{\"names\":[\"accept\",\"accept4\",\"access\",\"adjtimex\",\"alarm\",\"bind\",\"brk\",\"capget\",\"capset\",\"chdir\",\"chmod\",\"chown\",\"chown32\",\"clock_adjtime\",\"clock_getres\",\"clock_gettime\",\"clock_nanosleep\",\"clone\",\"close\",\"connect\",\"copy_file_range\",\"creat\",\"dup\",\"dup2\",\"dup3\",\"epoll_create\",\"epoll_create1\",\"epoll_ctl\",\"epoll_ctl_old\",\"epoll_pwait\",\"epoll_wait\",\"epoll_wait_old\",\"eventfd\",\"eventfd2\",\"execve\",\"execveat\",\"exit\",\"exit_group\",\"faccessat\",\"fadvise64\",\"fadvise64_64\",\"fallocate\",\"fanotify_mark\",\"fchdir\",\"fchmod\",\"fchmodat\",\"fchown\",\"fchown32\",\"fchownat\",\"fcntl\",\"fcntl64\",\"fdatasync\",\"fgetxattr\",\"flistxattr\",\"flock\",\"fork\",\"fremovexattr\",\"fsetxattr\",\"fstat\",\"fstat64\",\"fstatat64\",\"fstatfs\",\"fstatfs64\",\"fsync\",\"ftruncate\",\"ftruncate64\",\"futex\",\"futimesat\",\"getcpu\",\"getcwd\",\"getdents\",\"getdents64\",\"getegid\",\"getegid32\",\"geteuid\",\"geteuid32\",\"getgid\",\"getgid32\",\"getgroups\",\"getgroups32\",\"getitimer\",\"getpeername\",\"getpgid\",\"getpgrp\",\"getpid\",\"getppid\",\"getpriority\",\"getrandom\",\"getresgid\",\"getresgid32\",\"getresuid\",\"getresuid32\",\"getrlimit\",\"get_robust_list\",\"getrusage\",\"getsid\",\"getsockname\",\"getsockopt\",\"get_thread_area\",\"gettid\",\"gettimeofday\",\"getuid\",\"getuid32\",\"getxattr\",\"inotify_add_watch\",\"inotify_init\",\"inotify_init1\",\"inotify_rm_watch\",\"io_cancel\",\"ioctl\",\"io_destroy\",\"io_getevents\",\"ioprio_get\",\"ioprio_set\",\"io_setup\",\"io_submit\",\"ipc\",\"keyctl\",\"kill\",\"lchown\",\"lchown32\",\"lgetxattr\",\"link\",\"linkat\",\"listen\",\"listxattr\",\"llistxattr\",\"_llseek\",\"lremovexattr\",\"lseek\",\"lsetxattr\",\"lstat\",\"lstat64\",\"madvise\",\"memfd_create\",\"mincore\",\"mkdir\",\"mkdirat\",\"mknod\",\"mknodat\",\"mlock\",\"mlock2\",\"mlockall\",\"mmap\",\"mmap2\",\"mprotect\",\"mq_getsetattr\",\"mq_notify\",\"mq_open\",\"mq_timedreceive\",\"mq_timedsend\",\"mq_unlink\",\"mremap\",\"msgctl\",\"msgget\",\"msgrcv\",\"msgsnd\",\"msync\",\"munlock\",\"munlockall\",\"munmap\",\"nanosleep\",\"newfstatat\",\"_newselect\",\"open\",\"openat\",\"pause\",\"pipe\",\"pipe2\",\"pivot_root\",\"poll\",\"ppoll\",\"prctl\",\"pread64\",\"preadv\",\"preadv2\",\"prlimit64\",\"pselect6\",\"pwrite64\",\"pwritev\",\"pwritev2\",\"read\",\"readahead\",\"readlink\",\"readlinkat\",\"readv\",\"recv\",\"recvfrom\",\"recvmmsg\",\"recvmsg\",\"remap_file_pages\",\"removexattr\",\"rename\",\"renameat\",\"renameat2\",\"restart_syscall\",\"rmdir\",\"rt_sigaction\",\"rt_sigpending\",\"rt_sigprocmask\",\"rt_sigqueueinfo\",\"rt_sigreturn\",\"rt_sigsuspend\",\"rt_sigtimedwait\",\"rt_tgsigqueueinfo\",\"sched_getaffinity\",\"sched_getattr\",\"sched_getparam\",\"sched_get_priority_max\",\"sched_get_priority_min\",\"sched_getscheduler\",\"sched_rr_get_interval\",\"sched_setaffinity\",\"sched_setattr\",\"sched_setparam\",\"sched_setscheduler\",\"sched_yield\",\"seccomp\",\"select\",\"semctl\",\"semget\",\"semop\",\"semtimedop\",\"send\",\"sendfile\",\"sendfile64\",\"sendmmsg\",\"sendmsg\",\"sendto\",\"setfsgid\",\"setfsgid32\",\"setfsuid\",\"setfsuid32\",\"setgid\",\"setgid32\",\"setgroups\",\"setgroups32\",\"setitimer\",\"setpgid\",\"setpriority\",\"setregid\",\"setregid32\",\"setresgid\",\"setresgid32\",\"setresuid\",\"setresuid32\",\"setreuid\",\"setreuid32\",\"setrlimit\",\"set_robust_list\",\"setsid\",\"setsockopt\",\"set_thread_area\",\"set_tid_address\",\"setuid\",\"setuid32\",\"setxattr\",\"shmat\",\"shmctl\",\"shmdt\",\"shmget\",\"shutdown\",\"sigaltstack\",\"signalfd\",\"signalfd4\",\"sigreturn\",\"socket\",\"socketcall\",\"socketpair\",\"splice\",\"stat\",\"stat64\",\"statfs\",\"statfs64\",\"statx\",\"symlink\",\"symlinkat\",\"sync\",\"sync_file_range\",\"syncfs\",\"sysinfo\",\"syslog\",\"tee\",\"tgkill\",\"time\",\"timer_create\",\"timer_delete\",\"timerfd_create\",\"timerfd_gettime\",\"timerfd_settime\",\"timer_getoverrun\",\"timer_gettime\",\"timer_settime\",\"times\",\"tkill\",\"truncate\",\"truncate64\",\"ugetrlimit\",\"umask\",\"uname\",\"unlink\",\"unlinkat\",\"utime\",\"utimensat\",\"utimes\",\"vfork\",\"vmsplice\",\"wait4\",\"waitid\",\"waitpid\",\"write\",\"writev\",\"mount\",\"umount2\",\"reboot\",\"name_to_handle_at\",\"unshare\"],\"action\":\"SCMP_ACT_ALLOW\"},{\"names\":[\"personality\"],\"action\":\"SCMP_ACT_ALLOW\",\"args\":[{\"index\":0,\"value\":0,\"op\":\"SCMP_CMP_EQ\"}]},{\"names\":[\"personality\"],\"action\":\"SCMP_ACT_ALLOW\",\"args\":[{\"index\":0,\"value\":8,\"op\":\"SCMP_CMP_EQ\"}]},{\"names\":[\"personality\"],\"action\":\"SCMP_ACT_ALLOW\",\"args\":[{\"index\":0,\"value\":131072,\"op\":\"SCMP_CMP_EQ\"}]},{\"names\":[\"personality\"],\"action\":\"SCMP_ACT_ALLOW\",\"args\":[{\"index\":0,\"value\":131080,\"op\":\"SCMP_CMP_EQ\"}]},{\"names\":[\"personality\"],\"action\":\"SCMP_ACT_ALLOW\",\"args\":[{\"index\":0,\"value\":4294967295,\"op\":\"SCMP_CMP_EQ\"}]},{\"names\":[\"arch_prctl\"],\"action\":\"SCMP_ACT_ALLOW\"},{\"names\":[\"modify_ldt\"],\"action\":\"SCMP_ACT_ALLOW\"},{\"names\":[\"clone\"],\"action\":\"SCMP_ACT_ALLOW\",\"args\":[{\"index\":0,\"value\":2080505856,\"op\":\"SCMP_CMP_MASKED_EQ\"}]},{\"names\":[\"chroot\"],\"action\":\"SCMP_ACT_ALLOW\"}]},\"maskedPaths\":[\"/proc/acpi\",\"/proc/kcore\",\"/proc/keys\",\"/proc/latency_stats\",\"/proc/timer_list\",\"/proc/timer_stats\",\"/proc/sched_debug\",\"/proc/scsi\",\"/sys/firmware\"],\"readonlyPaths\":[\"/proc/asound\",\"/proc/bus\",\"/proc/fs\",\"/proc/irq\",\"/proc/sys\",\"/proc/sysrq-trigger\"],\"mountLabel\":\"system_u:object_r:container_file_t:s0:c306,c684\"}}"
level=debug msg="Running [\"runc\" \"create\" \"--bundle\" \"/var/tmp/buildah828050619\" \"--pid-file\" \"/var/tmp/buildah828050619/pid\" \"buildah-buildah828050619\"]"
level=debug msg="Running [\"runc\" \"start\" \"buildah-buildah828050619\"]"
level=debug msg="closing stdin"
level=debug msg="Parsed Step: {Env:[PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin LANG=en_US.UTF-8 container=oci] Command:run Args:[dnf -y install openstack-ceilometer-central && dnf clean all && rm -rf /var/cache/dnf] Flags:[] Attrs:map[] Message:RUN dnf -y install openstack-ceilometer-central && dnf clean all && rm -rf /var/cache/dnf Original:RUN dnf -y install openstack-ceilometer-central && dnf clean all && rm -rf /var/cache/dnf}"
STEP 3: RUN dnf -y install openstack-ceilometer-central && dnf clean all && rm -rf /var/cache/dnf
level=debug msg="RUN imagebuilder.Run{Shell:true, Args:[]string{\"dnf -y install openstack-ceilometer-central && dnf clean all && rm -rf /var/cache/dnf\"}}, docker.Config{Hostname:\"eba898107bd8\", Domainname:\"\", User:\"\", Memory:0, MemorySwap:0, MemoryReservation:0, KernelMemory:0, CPUShares:0, CPUSet:\"\", PortSpecs:[]string(nil), ExposedPorts:map[docker.Port]struct {}{}, PublishService:\"\", StopSignal:\"SIGTERM\", StopTimeout:0, Env:[]string{\"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin\", \"LANG=en_US.UTF-8\", \"container=oci\"}, Cmd:[]string{\"kolla_start\"}, Shell:[]string{}, Healthcheck:(*docker.HealthConfig)(nil), DNS:[]string(nil), Image:\"\", Volumes:map[string]struct {}{}, VolumeDriver:\"\", WorkingDir:\"\", MacAddress:\"\", Entrypoint:[]string{\"dumb-init\", \"--single-child\", \"--\"}, SecurityOpts:[]string(nil), OnBuild:[]string{}, Mounts:[]docker.Mount(nil), Labels:map[string]string{\"architecture\":\"x86_64\", \"build-date\":\"2020-07-22T12:11:33.547097\", \"com.redhat.build-host\":\"cpt-1007.osbs.prod.upshift.rdu2.redhat.com\", \"com.redhat.component\":\"ubi8-container\", \"com.redhat.license_terms\":\"https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI\", \"description\":\"The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.\", \"distribution-scope\":\"public\", \"io.k8s.description\":\"The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.\", \"io.k8s.display-name\":\"Red Hat Universal Base Image 8\", \"io.openshift.expose-services\":\"\", \"io.openshift.tags\":\"base rhel8\", \"kolla_version\":\"none\", \"maintainer\":\"OpenStack TripleO team\", \"name\":\"ubi8\", \"release\":\"343\", \"summary\":\"Provides the latest release of Red Hat Universal Base Image 8.\", \"url\":\"https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.2-343\", \"vcs-ref\":\"0fede9a6ae85a36962206913c66bfe9965c49940\", \"vcs-type\":\"git\", \"vendor\":\"Red Hat, Inc.\", \"version\":\"8.2\"}, AttachStdin:false, AttachStdout:false, AttachStderr:false, ArgsEscaped:false, Tty:false, OpenStdin:false, StdinOnce:false, NetworkDisabled:false, VolumesFrom:\"\"}"
level=debug msg="using \"/var/tmp/buildah880575913\" to hold bundle data"
level=debug msg="Resources: &buildah.CommonBuildOptions{AddHost:[]string{}, CgroupParent:\"\", CPUPeriod:0x0, CPUQuota:0, CPUShares:0x0, CPUSetCPUs:\"\", CPUSetMems:\"\", HTTPProxy:true, Memory:0, DNSSearch:[]string{}, DNSServers:[]string{}, DNSOptions:[]string{}, MemorySwap:0, LabelOpts:[]string(nil), SeccompProfilePath:\"/usr/share/containers/seccomp.json\", ApparmorProfile:\"\", ShmSize:\"65536k\", Ulimit:[]string{}, Volumes:[]string{\"/etc/yum.repos.d:/etc/yum.repos.d:z\", \"/etc/pki/rpm-gpg:/etc/pki/rpm-gpg:z\", \"/home/centos/repos:/etc/yum.repos.d:z\", \"/etc/pki/rpm-gpg:/etc/pki/rpm-gpg:z\"}}"
level=debug msg="stdio is not a terminal, defaulting to not using a terminal"
level=debug msg="ensuring working directory \"/var/lib/containers/storage/overlay/d479d05fece5300915b192c28ea04540ea43e93a0a9cc298c48dee46814161c1/merged\" exists"
level=debug msg="/etc/system-fips does not exist on host, not mounting FIPS mode secret"
level=debug msg="setting up mounted volume at \"/etc/pki/rpm-gpg\""
level=debug msg="setting up mounted volume at \"/etc/yum.repos.d\""
level=debug msg="setting up mounted volume at \"/etc/pki/rpm-gpg\""
level=debug msg="setting up mounted volume at \"/etc/yum.repos.d\""
level=debug msg="bind mounted \"/var/lib/containers/storage/overlay/d479d05fece5300915b192c28ea04540ea43e93a0a9cc298c48dee46814161c1/merged\" to \"/var/tmp/buildah880575913/mnt/rootfs\""
level=debug msg="bind mounted \"/etc/pki/rpm-gpg\" to \"/var/tmp/buildah880575913/mnt/buildah-bind-target-0\""
level=debug msg="bind mounted \"/home/centos/repos\" to \"/var/tmp/buildah880575913/mnt/buildah-bind-target-1\""
level=debug msg="bind mounted \"/var/lib/containers/storage/overlay-containers/a945de1513214af498237f0d209fea047e44d1bcdbbbd63f48514d3b9e7f37be/userdata/run/secrets\" to \"/var/tmp/buildah880575913/mnt/buildah-bind-target-2\""
level=debug msg="config = {\"ociVersion\":\"1.0.2-dev\",\"process\":{\"user\":{\"uid\":0,\"gid\":0},\"args\":[\"/bin/sh\",\"-c\",\"dnf -y install openstack-ceilometer-central \\u0026\\u0026 dnf clean all \\u0026\\u0026 rm -rf /var/cache/dnf\"],\"env\":[\"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin\",\"LANG=en_US.UTF-8\",\"container=oci\",\"HOSTNAME=eba898107bd8\"],\"cwd\":\"/\",\"capabilities\":{\"bounding\":[\"CAP_AUDIT_WRITE\",\"CAP_CHOWN\",\"CAP_DAC_OVERRIDE\",\"CAP_FOWNER\",\"CAP_FSETID\",\"CAP_KILL\",\"CAP_MKNOD\",\"CAP_NET_BIND_SERVICE\",\"CAP_NET_RAW\",\"CAP_SETFCAP\",\"CAP_SETGID\",\"CAP_SETPCAP\",\"CAP_SETUID\",\"CAP_SYS_CHROOT\"],\"effective\":[\"CAP_AUDIT_WRITE\",\"CAP_CHOWN\",\"CAP_DAC_OVERRIDE\",\"CAP_FOWNER\",\"CAP_FSETID\",\"CAP_KILL\",\"CAP_MKNOD\",\"CAP_NET_BIND_SERVICE\",\"CAP_NET_RAW\",\"CAP_SETFCAP\",\"CAP_SETGID\",\"CAP_SETPCAP\",\"CAP_SETUID\",\"CAP_SYS_CHROOT\"],\"inheritable\":[\"CAP_AUDIT_WRITE\",\"CAP_CHOWN\",\"CAP_DAC_OVERRIDE\",\"CAP_FOWNER\",\"CAP_FSETID\",\"CAP_KILL\",\"CAP_MKNOD\",\"CAP_NET_BIND_SERVICE\",\"CAP_NET_RAW\",\"CAP_SETFCAP\",\"CAP_SETGID\",\"CAP_SETPCAP\",\"CAP_SETUID\",\"CAP_SYS_CHROOT\"],\"permitted\":[\"CAP_AUDIT_WRITE\",\"CAP_CHOWN\",\"CAP_DAC_OVERRIDE\",\"CAP_FOWNER\",\"CAP_FSETID\",\"CAP_KILL\",\"CAP_MKNOD\",\"CAP_NET_BIND_SERVICE\",\"CAP_NET_RAW\",\"CAP_SETFCAP\",\"CAP_SETGID\",\"CAP_SETPCAP\",\"CAP_SETUID\",\"CAP_SYS_CHROOT\"],\"ambient\":[\"CAP_AUDIT_WRITE\",\"CAP_CHOWN\",\"CAP_DAC_OVERRIDE\",\"CAP_FOWNER\",\"CAP_FSETID\",\"CAP_KILL\",\"CAP_MKNOD\",\"CAP_NET_BIND_SERVICE\",\"CAP_NET_RAW\",\"CAP_SETFCAP\",\"CAP_SETGID\",\"CAP_SETPCAP\",\"CAP_SETUID\",\"CAP_SYS_CHROOT\"]},\"rlimits\":[{\"type\":\"RLIMIT_NOFILE\",\"hard\":1024,\"soft\":1024},{\"type\":\"RLIMIT_NPROC\",\"hard\":4194304,\"soft\":4194304}],\"selinuxLabel\":\"system_u:system_r:container_t:s0:c306,c684\"},\"root\":{\"path\":\"/var/tmp/buildah880575913/mnt/rootfs\"},\"hostname\":\"eba898107bd8\",\"mounts\":[{\"destination\":\"/etc/pki/rpm-gpg\",\"type\":\"bind\",\"source\":\"/var/tmp/buildah880575913/mnt/buildah-bind-target-0\",\"options\":[\"z\",\"rw\",\"private\",\"rbind\"]},{\"destination\":\"/etc/yum.repos.d\",\"type\":\"bind\",\"source\":\"/var/tmp/buildah880575913/mnt/buildah-bind-target-1\",\"options\":[\"z\",\"rw\",\"private\",\"rbind\"]},{\"destination\":\"/run/secrets\",\"type\":\"bind\",\"source\":\"/var/tmp/buildah880575913/mnt/buildah-bind-target-2\",\"options\":[\"bind\",\"rprivate\"]},{\"destination\":\"/etc/resolv.conf\",\"type\":\"bind\",\"source\":\"/var/tmp/buildah880575913/resolv.conf\",\"options\":[\"rbind\"]},{\"destination\":\"/run/.containerenv\",\"type\":\"bind\",\"source\":\"/var/tmp/buildah880575913/run/.containerenv\",\"options\":[\"rbind\"]},{\"destination\":\"/etc/hosts\",\"type\":\"bind\",\"source\":\"/var/tmp/buildah880575913/hosts\",\"options\":[\"rbind\"]},{\"destination\":\"/proc\",\"type\":\"proc\",\"source\":\"proc\",\"options\":[\"nosuid\",\"noexec\",\"nodev\"]},{\"destination\":\"/dev\",\"type\":\"tmpfs\",\"source\":\"tmpfs\",\"options\":[\"nosuid\",\"strictatime\",\"mode=755\",\"size=65536k\"]},{\"destination\":\"/dev/pts\",\"type\":\"devpts\",\"source\":\"devpts\",\"options\":[\"nosuid\",\"noexec\",\"newinstance\",\"ptmxmode=0666\",\"mode=0620\",\"gid=5\"]},{\"destination\":\"/dev/shm\",\"type\":\"tmpfs\",\"source\":\"shm\",\"options\":[\"nosuid\",\"noexec\",\"nodev\",\"mode=1777\",\"size=65536k\"]},{\"destination\":\"/dev/mqueue\",\"type\":\"mqueue\",\"source\":\"mqueue\",\"options\":[\"nosuid\",\"noexec\",\"nodev\"]},{\"destination\":\"/sys\",\"type\":\"sysfs\",\"source\":\"sysfs\",\"options\":[\"nosuid\",\"noexec\",\"nodev\",\"ro\"]},{\"destination\":\"/sys/fs/cgroup\",\"type\":\"cgroup\",\"source\":\"cgroup\",\"options\":[\"nosuid\",\"noexec\",\"nodev\",\"relatime\",\"ro\"]}],\"linux\":{\"resources\":{\"devices\":[{\"allow\":false,\"access\":\"rwm\"}]},\"namespaces\":[{\"type\":\"pid\"},{\"type\":\"ipc\"},{\"type\":\"uts\"},{\"type\":\"mount\"}],\"seccomp\":{\"defaultAction\":\"SCMP_ACT_ERRNO\",\"architectures\":[\"SCMP_ARCH_X86_64\",\"SCMP_ARCH_X86\",\"SCMP_ARCH_X32\"],\"syscalls\":[{\"names\":[\"accept\",\"accept4\",\"access\",\"adjtimex\",\"alarm\",\"bind\",\"brk\",\"capget\",\"capset\",\"chdir\",\"chmod\",\"chown\",\"chown32\",\"clock_adjtime\",\"clock_getres\",\"clock_gettime\",\"clock_nanosleep\",\"clone\",\"close\",\"connect\",\"copy_file_range\",\"creat\",\"dup\",\"dup2\",\"dup3\",\"epoll_create\",\"epoll_create1\",\"epoll_ctl\",\"epoll_ctl_old\",\"epoll_pwait\",\"epoll_wait\",\"epoll_wait_old\",\"eventfd\",\"eventfd2\",\"execve\",\"execveat\",\"exit\",\"exit_group\",\"faccessat\",\"fadvise64\",\"fadvise64_64\",\"fallocate\",\"fanotify_mark\",\"fchdir\",\"fchmod\",\"fchmodat\",\"fchown\",\"fchown32\",\"fchownat\",\"fcntl\",\"fcntl64\",\"fdatasync\",\"fgetxattr\",\"flistxattr\",\"flock\",\"fork\",\"fremovexattr\",\"fsetxattr\",\"fstat\",\"fstat64\",\"fstatat64\",\"fstatfs\",\"fstatfs64\",\"fsync\",\"ftruncate\",\"ftruncate64\",\"futex\",\"futimesat\",\"getcpu\",\"getcwd\",\"getdents\",\"getdents64\",\"getegid\",\"getegid32\",\"geteuid\",\"geteuid32\",\"getgid\",\"getgid32\",\"getgroups\",\"getgroups32\",\"getitimer\",\"getpeername\",\"getpgid\",\"getpgrp\",\"getpid\",\"getppid\",\"getpriority\",\"getrandom\",\"getresgid\",\"getresgid32\",\"getresuid\",\"getresuid32\",\"getrlimit\",\"get_robust_list\",\"getrusage\",\"getsid\",\"getsockname\",\"getsockopt\",\"get_thread_area\",\"gettid\",\"gettimeofday\",\"getuid\",\"getuid32\",\"getxattr\",\"inotify_add_watch\",\"inotify_init\",\"inotify_init1\",\"inotify_rm_watch\",\"io_cancel\",\"ioctl\",\"io_destroy\",\"io_getevents\",\"ioprio_get\",\"ioprio_set\",\"io_setup\",\"io_submit\",\"ipc\",\"keyctl\",\"kill\",\"lchown\",\"lchown32\",\"lgetxattr\",\"link\",\"linkat\",\"listen\",\"listxattr\",\"llistxattr\",\"_llseek\",\"lremovexattr\",\"lseek\",\"lsetxattr\",\"lstat\",\"lstat64\",\"madvise\",\"memfd_create\",\"mincore\",\"mkdir\",\"mkdirat\",\"mknod\",\"mknodat\",\"mlock\",\"mlock2\",\"mlockall\",\"mmap\",\"mmap2\",\"mprotect\",\"mq_getsetattr\",\"mq_notify\",\"mq_open\",\"mq_timedreceive\",\"mq_timedsend\",\"mq_unlink\",\"mremap\",\"msgctl\",\"msgget\",\"msgrcv\",\"msgsnd\",\"msync\",\"munlock\",\"munlockall\",\"munmap\",\"nanosleep\",\"newfstatat\",\"_newselect\",\"open\",\"openat\",\"pause\",\"pipe\",\"pipe2\",\"pivot_root\",\"poll\",\"ppoll\",\"prctl\",\"pread64\",\"preadv\",\"preadv2\",\"prlimit64\",\"pselect6\",\"pwrite64\",\"pwritev\",\"pwritev2\",\"read\",\"readahead\",\"readlink\",\"readlinkat\",\"readv\",\"recv\",\"recvfrom\",\"recvmmsg\",\"recvmsg\",\"remap_file_pages\",\"removexattr\",\"rename\",\"renameat\",\"renameat2\",\"restart_syscall\",\"rmdir\",\"rt_sigaction\",\"rt_sigpending\",\"rt_sigprocmask\",\"rt_sigqueueinfo\",\"rt_sigreturn\",\"rt_sigsuspend\",\"rt_sigtimedwait\",\"rt_tgsigqueueinfo\",\"sched_getaffinity\",\"sched_getattr\",\"sched_getparam\",\"sched_get_priority_max\",\"sched_get_priority_min\",\"sched_getscheduler\",\"sched_rr_get_interval\",\"sched_setaffinity\",\"sched_setattr\",\"sched_setparam\",\"sched_setscheduler\",\"sched_yield\",\"seccomp\",\"select\",\"semctl\",\"semget\",\"semop\",\"semtimedop\",\"send\",\"sendfile\",\"sendfile64\",\"sendmmsg\",\"sendmsg\",\"sendto\",\"setfsgid\",\"setfsgid32\",\"setfsuid\",\"setfsuid32\",\"setgid\",\"setgid32\",\"setgroups\",\"setgroups32\",\"setitimer\",\"setpgid\",\"setpriority\",\"setregid\",\"setregid32\",\"setresgid\",\"setresgid32\",\"setresuid\",\"setresuid32\",\"setreuid\",\"setreuid32\",\"setrlimit\",\"set_robust_list\",\"setsid\",\"setsockopt\",\"set_thread_area\",\"set_tid_address\",\"setuid\",\"setuid32\",\"setxattr\",\"shmat\",\"shmctl\",\"shmdt\",\"shmget\",\"shutdown\",\"sigaltstack\",\"signalfd\",\"signalfd4\",\"sigreturn\",\"socket\",\"socketcall\",\"socketpair\",\"splice\",\"stat\",\"stat64\",\"statfs\",\"statfs64\",\"statx\",\"symlink\",\"symlinkat\",\"sync\",\"sync_file_range\",\"syncfs\",\"sysinfo\",\"syslog\",\"tee\",\"tgkill\",\"time\",\"timer_create\",\"timer_delete\",\"timerfd_create\",\"timerfd_gettime\",\"timerfd_settime\",\"timer_getoverrun\",\"timer_gettime\",\"timer_settime\",\"times\",\"tkill\",\"truncate\",\"truncate64\",\"ugetrlimit\",\"umask\",\"uname\",\"unlink\",\"unlinkat\",\"utime\",\"utimensat\",\"utimes\",\"vfork\",\"vmsplice\",\"wait4\",\"waitid\",\"waitpid\",\"write\",\"writev\",\"mount\",\"umount2\",\"reboot\",\"name_to_handle_at\",\"unshare\"],\"action\":\"SCMP_ACT_ALLOW\"},{\"names\":[\"personality\"],\"action\":\"SCMP_ACT_ALLOW\",\"args\":[{\"index\":0,\"value\":0,\"op\":\"SCMP_CMP_EQ\"}]},{\"names\":[\"personality\"],\"action\":\"SCMP_ACT_ALLOW\",\"args\":[{\"index\":0,\"value\":8,\"op\":\"SCMP_CMP_EQ\"}]},{\"names\":[\"personality\"],\"action\":\"SCMP_ACT_ALLOW\",\"args\":[{\"index\":0,\"value\":131072,\"op\":\"SCMP_CMP_EQ\"}]},{\"names\":[\"personality\"],\"action\":\"SCMP_ACT_ALLOW\",\"args\":[{\"index\":0,\"value\":131080,\"op\":\"SCMP_CMP_EQ\"}]},{\"names\":[\"personality\"],\"action\":\"SCMP_ACT_ALLOW\",\"args\":[{\"index\":0,\"value\":4294967295,\"op\":\"SCMP_CMP_EQ\"}]},{\"names\":[\"arch_prctl\"],\"action\":\"SCMP_ACT_ALLOW\"},{\"names\":[\"modify_ldt\"],\"action\":\"SCMP_ACT_ALLOW\"},{\"names\":[\"clone\"],\"action\":\"SCMP_ACT_ALLOW\",\"args\":[{\"index\":0,\"value\":2080505856,\"op\":\"SCMP_CMP_MASKED_EQ\"}]},{\"names\":[\"chroot\"],\"action\":\"SCMP_ACT_ALLOW\"}]},\"maskedPaths\":[\"/proc/acpi\",\"/proc/kcore\",\"/proc/keys\",\"/proc/latency_stats\",\"/proc/timer_list\",\"/proc/timer_stats\",\"/proc/sched_debug\",\"/proc/scsi\",\"/sys/firmware\"],\"readonlyPaths\":[\"/proc/asound\",\"/proc/bus\",\"/proc/fs\",\"/proc/irq\",\"/proc/sys\",\"/proc/sysrq-trigger\"],\"mountLabel\":\"system_u:object_r:container_file_t:s0:c306,c684\"}}"
level=debug msg="Running [\"runc\" \"create\" \"--bundle\" \"/var/tmp/buildah880575913\" \"--pid-file\" \"/var/tmp/buildah880575913/pid\" \"buildah-buildah880575913\"]"
level=debug msg="Running [\"runc\" \"start\" \"buildah-buildah880575913\"]"
level=debug msg="closing stdin"
Updating Subscription Management repositories.
Unable to read consumer identity
Subscription Manager is operating in container mode.
This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register.
delorean-openstack-ironic-a2a27d57fafe1073313a8 195 kB/s |  48 kB     00:00    
delorean-openstack-cinder-641762befc39dbc43953b  85 kB/s |  27 kB     00:00    
delorean-python-designateclient-055d1601beb9564 409 kB/s | 126 kB     00:00    
delorean-openstack-ceilometer-5af99caad73cf0af3  87 kB/s |  25 kB     00:00    
delorean-openstack-tobiko-ec4fc975812e8611a2401 799 kB/s | 283 kB     00:00    
delorean-openstack-nova-ce68f2a7589c0ce399e645f 161 kB/s |  44 kB     00:00    
delorean-python-glance-store-4a9c5d2fa94b772dc4  67 kB/s |  16 kB     00:00    
delorean-openstack-manila-f78e2fdee7d1ed05276dc  92 kB/s |  23 kB     00:00    
delorean-openstack-neutron-dynamic-routing-e627 422 kB/s | 150 kB     00:00    
delorean-openstack-octavia-ef86070ff122da69caac  74 kB/s |  24 kB     00:00    
delorean-openstack-keystone-952959fb872b25d4ad5 235 kB/s |  52 kB     00:00    
delorean-openstack-swift-d50b50ba8d28eab544b723  42 kB/s |  13 kB     00:00    
delorean-python-tempestconf-c3771689de2c066e8e0 199 kB/s |  55 kB     00:00    
delorean-openstack-tripleo-common-f34782381cdb6 690 kB/s | 249 kB     00:00    
delorean-openstack-magnum-ui-6fa4868a7739087dab 405 kB/s |  91 kB     00:00    
delorean-python-validations-libs-21a722adac9c84  17 kB/s | 4.2 kB     00:00    
delorean-openstack-ironic-python-agent-a9ed390f 191 kB/s |  48 kB     00:00    
delorean-openstack-cinder-b204df52cc32e77eddebc  97 kB/s |  27 kB     00:00    
delorean-python-troveclient-c23da586e9466cf77a8 488 kB/s | 126 kB     00:00    
delorean-openstack-ceilometer-5af99caad73cf0af3 106 kB/s |  25 kB     00:00    
delorean-openstack-murano-371e99e473c91a1188c2a 1.0 MB/s | 283 kB     00:00    
delorean-python-ec2api-tests-tempest-58b022c333 159 kB/s |  44 kB     00:00    
delorean-python-glance-store-25143e36bc41b03a15  44 kB/s |  16 kB     00:00    
delorean-openstack-manila-fba472e3a61aaa791c71b  81 kB/s |  23 kB     00:00    
delorean-openstack-neutron-fe79ef22b8edadc02c54 488 kB/s | 150 kB     00:00    
delorean-openstack-octavia-08fad7496612962418c8  95 kB/s |  24 kB     00:00    
delorean-python-castellan-5bc001aa5ad14ab0e076e 180 kB/s |  52 kB     00:00    
delorean-openstack-swift-50800aba37947f6c1a88b8  52 kB/s |  13 kB     00:00    
delorean-python-vitrage-tests-tempest-375af0391 216 kB/s |  55 kB     00:00    
delorean-puppet-tripleo-9745e15af47c8d14d46ae1c 888 kB/s | 248 kB     00:00    
delorean-openstack-designate-ui-00c1142e944ea8d 371 kB/s |  91 kB     00:00    
delorean-python-validations-libs-21a722adac9c84  15 kB/s | 4.2 kB     00:00    
CentOS-8 - AppStream                            2.8 MB/s | 5.8 MB     00:02    
CentOS-8 - Base                                 2.3 MB/s | 2.2 MB     00:00    
CentOS-8 - Extras                                14 kB/s | 7.0 kB     00:00    
dlrn-master-testing                             4.1 MB/s | 1.4 MB     00:00    
dlrn-master-build-deps                          952 kB/s | 401 kB     00:00    
Advanced Virtualization mirror                  283 kB/s | 103 kB     00:00    
Messaging RabbitMQ                              374 kB/s | 137 kB     00:00    
opstools                                        280 kB/s | 117 kB     00:00    
tripleo-centos-ceph-nautilus                    549 kB/s | 207 kB     00:00    
tripleo-centos-highavailability                 934 kB/s | 507 kB     00:00    
tripleo-centos-powertools                       2.2 MB/s | 1.9 MB     00:00    
Dependencies resolved.
================================================================================================================================
 Package                        Arch    Version                               Repository                                    Size
================================================================================================================================
Installing:
 openstack-ceilometer-central   noarch  1:14.1.0-0.20200724132416.5af99ca.el8 delorean-component-cloudops-current-tripleo  7.7 k
Installing dependencies:
 cyrus-sasl                     x86_64  2.1.27-1.el8                          BaseOS                                        96 k
 cyrus-sasl-gssapi              x86_64  2.1.27-1.el8                          BaseOS                                        49 k
 libvirt-libs                   x86_64  6.0.0-17.el8                          advanced-virtualization                      4.3 M
 numactl-libs                   x86_64  2.0.12-9.el8                          BaseOS                                        36 k
 openstack-ceilometer-polling   noarch  1:14.1.0-0.20200724132416.5af99ca.el8 delorean-component-cloudops-current-tripleo  8.3 k
 python3-libvirt                x86_64  6.0.0-1.el8                           advanced-virtualization                      306 k
 yajl                           x86_64  2.1.0-10.el8                          AppStream                                     41 k

Transaction Summary
================================================================================================================================
Install  8 Packages

Total download size: 4.8 M
Installed size: 25 M
Downloading Packages:
(1/8): openstack-ceilometer-polling-14.1.0-0.20  56 kB/s | 8.3 kB     00:00    
(2/8): openstack-ceilometer-central-14.1.0-0.20  47 kB/s | 7.7 kB     00:00    
(3/8): yajl-2.1.0-10.el8.x86_64.rpm             208 kB/s |  41 kB     00:00    
(4/8): numactl-libs-2.0.12-9.el8.x86_64.rpm     210 kB/s |  36 kB     00:00    
(5/8): cyrus-sasl-gssapi-2.1.27-1.el8.x86_64.rp 194 kB/s |  49 kB     00:00    
(6/8): cyrus-sasl-2.1.27-1.el8.x86_64.rpm       294 kB/s |  96 kB     00:00    
(7/8): python3-libvirt-6.0.0-1.el8.x86_64.rpm   1.1 MB/s | 306 kB     00:00    
(8/8): libvirt-libs-6.0.0-17.el8.x86_64.rpm     2.8 MB/s | 4.3 MB     00:01    
--------------------------------------------------------------------------------
Total                                           2.0 MB/s | 4.8 MB     00:02     
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Preparing        :                                                        1/1 
  Installing       : numactl-libs-2.0.12-9.el8.x86_64                       1/8 
  Running scriptlet: numactl-libs-2.0.12-9.el8.x86_64                       1/8 
  Installing       : cyrus-sasl-gssapi-2.1.27-1.el8.x86_64                  2/8 
  Running scriptlet: cyrus-sasl-2.1.27-1.el8.x86_64                         3/8 
  Installing       : cyrus-sasl-2.1.27-1.el8.x86_64                         3/8 
  Running scriptlet: cyrus-sasl-2.1.27-1.el8.x86_64                         3/8 
  Installing       : yajl-2.1.0-10.el8.x86_64                               4/8 
  Installing       : libvirt-libs-6.0.0-17.el8.x86_64                       5/8 
  Running scriptlet: libvirt-libs-6.0.0-17.el8.x86_64                       5/8 
  Installing       : python3-libvirt-6.0.0-1.el8.x86_64                     6/8 
  Installing       : openstack-ceilometer-polling-1:14.1.0-0.202007241324   7/8 
  Running scriptlet: openstack-ceilometer-polling-1:14.1.0-0.202007241324   7/8 
  Installing       : openstack-ceilometer-central-1:14.1.0-0.202007241324   8/8 
  Running scriptlet: openstack-ceilometer-central-1:14.1.0-0.202007241324   8/8 
  Verifying        : openstack-ceilometer-central-1:14.1.0-0.202007241324   1/8 
  Verifying        : openstack-ceilometer-polling-1:14.1.0-0.202007241324   2/8 
  Verifying        : yajl-2.1.0-10.el8.x86_64                               3/8 
  Verifying        : cyrus-sasl-2.1.27-1.el8.x86_64                         4/8 
  Verifying        : cyrus-sasl-gssapi-2.1.27-1.el8.x86_64                  5/8 
  Verifying        : numactl-libs-2.0.12-9.el8.x86_64                       6/8 
  Verifying        : libvirt-libs-6.0.0-17.el8.x86_64                       7/8 
  Verifying        : python3-libvirt-6.0.0-1.el8.x86_64                     8/8 
Installed products updated.

Installed:
  cyrus-sasl-2.1.27-1.el8.x86_64                                                
  cyrus-sasl-gssapi-2.1.27-1.el8.x86_64                                         
  libvirt-libs-6.0.0-17.el8.x86_64                                              
  numactl-libs-2.0.12-9.el8.x86_64                                              
  openstack-ceilometer-central-1:14.1.0-0.20200724132416.5af99ca.el8.noarch     
  openstack-ceilometer-polling-1:14.1.0-0.20200724132416.5af99ca.el8.noarch     
  python3-libvirt-6.0.0-1.el8.x86_64                                            
  yajl-2.1.0-10.el8.x86_64                                                      

Complete!
Updating Subscription Management repositories.
Unable to read consumer identity
Subscription Manager is operating in container mode.
This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register.
222 files removed
level=debug msg="Parsed Step: {Env:[PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin LANG=en_US.UTF-8 container=oci] Command:run Args:[ln -s /usr/share/openstack-tripleo-common/healthcheck/ceilometer-agent-central /openstack/healthcheck && chmod a+rx /openstack/healthcheck] Flags:[] Attrs:map[] Message:RUN ln -s /usr/share/openstack-tripleo-common/healthcheck/ceilometer-agent-central /openstack/healthcheck && chmod a+rx /openstack/healthcheck Original:RUN ln -s /usr/share/openstack-tripleo-common/healthcheck/ceilometer-agent-central /openstack/healthcheck && chmod a+rx /openstack/healthcheck}"
STEP 4: RUN ln -s /usr/share/openstack-tripleo-common/healthcheck/ceilometer-agent-central /openstack/healthcheck && chmod a+rx /openstack/healthcheck
level=debug msg="RUN imagebuilder.Run{Shell:true, Args:[]string{\"ln -s /usr/share/openstack-tripleo-common/healthcheck/ceilometer-agent-central /openstack/healthcheck && chmod a+rx /openstack/healthcheck\"}}, docker.Config{Hostname:\"eba898107bd8\", Domainname:\"\", User:\"\", Memory:0, MemorySwap:0, MemoryReservation:0, KernelMemory:0, CPUShares:0, CPUSet:\"\", PortSpecs:[]string(nil), ExposedPorts:map[docker.Port]struct {}{}, PublishService:\"\", StopSignal:\"SIGTERM\", StopTimeout:0, Env:[]string{\"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin\", \"LANG=en_US.UTF-8\", \"container=oci\"}, Cmd:[]string{\"kolla_start\"}, Shell:[]string{}, Healthcheck:(*docker.HealthConfig)(nil), DNS:[]string(nil), Image:\"\", Volumes:map[string]struct {}{}, VolumeDriver:\"\", WorkingDir:\"\", MacAddress:\"\", Entrypoint:[]string{\"dumb-init\", \"--single-child\", \"--\"}, SecurityOpts:[]string(nil), OnBuild:[]string{}, Mounts:[]docker.Mount(nil), Labels:map[string]string{\"architecture\":\"x86_64\", \"build-date\":\"2020-07-22T12:11:33.547097\", \"com.redhat.build-host\":\"cpt-1007.osbs.prod.upshift.rdu2.redhat.com\", \"com.redhat.component\":\"ubi8-container\", \"com.redhat.license_terms\":\"https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI\", \"description\":\"The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.\", \"distribution-scope\":\"public\", \"io.k8s.description\":\"The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.\", \"io.k8s.display-name\":\"Red Hat Universal Base Image 8\", \"io.openshift.expose-services\":\"\", \"io.openshift.tags\":\"base rhel8\", \"kolla_version\":\"none\", \"maintainer\":\"OpenStack TripleO team\", \"name\":\"ubi8\", \"release\":\"343\", \"summary\":\"Provides the latest release of Red Hat Universal Base Image 8.\", \"url\":\"https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.2-343\", \"vcs-ref\":\"0fede9a6ae85a36962206913c66bfe9965c49940\", \"vcs-type\":\"git\", \"vendor\":\"Red Hat, Inc.\", \"version\":\"8.2\"}, AttachStdin:false, AttachStdout:false, AttachStderr:false, ArgsEscaped:false, Tty:false, OpenStdin:false, StdinOnce:false, NetworkDisabled:false, VolumesFrom:\"\"}"
level=debug msg="using \"/var/tmp/buildah285435815\" to hold bundle data"
level=debug msg="Resources: &buildah.CommonBuildOptions{AddHost:[]string{}, CgroupParent:\"\", CPUPeriod:0x0, CPUQuota:0, CPUShares:0x0, CPUSetCPUs:\"\", CPUSetMems:\"\", HTTPProxy:true, Memory:0, DNSSearch:[]string{}, DNSServers:[]string{}, DNSOptions:[]string{}, MemorySwap:0, LabelOpts:[]string(nil), SeccompProfilePath:\"/usr/share/containers/seccomp.json\", ApparmorProfile:\"\", ShmSize:\"65536k\", Ulimit:[]string{}, Volumes:[]string{\"/etc/yum.repos.d:/etc/yum.repos.d:z\", \"/etc/pki/rpm-gpg:/etc/pki/rpm-gpg:z\", \"/home/centos/repos:/etc/yum.repos.d:z\", \"/etc/pki/rpm-gpg:/etc/pki/rpm-gpg:z\"}}"
level=debug msg="stdio is not a terminal, defaulting to not using a terminal"
level=debug msg="ensuring working directory \"/var/lib/containers/storage/overlay/d479d05fece5300915b192c28ea04540ea43e93a0a9cc298c48dee46814161c1/merged\" exists"
level=debug msg="/etc/system-fips does not exist on host, not mounting FIPS mode secret"
level=debug msg="setting up mounted volume at \"/etc/pki/rpm-gpg\""
level=debug msg="setting up mounted volume at \"/etc/yum.repos.d\""
level=debug msg="setting up mounted volume at \"/etc/pki/rpm-gpg\""
level=debug msg="setting up mounted volume at \"/etc/yum.repos.d\""
level=debug msg="bind mounted \"/var/lib/containers/storage/overlay/d479d05fece5300915b192c28ea04540ea43e93a0a9cc298c48dee46814161c1/merged\" to \"/var/tmp/buildah285435815/mnt/rootfs\""
level=debug msg="bind mounted \"/etc/pki/rpm-gpg\" to \"/var/tmp/buildah285435815/mnt/buildah-bind-target-0\""
level=debug msg="bind mounted \"/home/centos/repos\" to \"/var/tmp/buildah285435815/mnt/buildah-bind-target-1\""
level=debug msg="bind mounted \"/var/lib/containers/storage/overlay-containers/a945de1513214af498237f0d209fea047e44d1bcdbbbd63f48514d3b9e7f37be/userdata/run/secrets\" to \"/var/tmp/buildah285435815/mnt/buildah-bind-target-2\""
level=debug msg="config = {\"ociVersion\":\"1.0.2-dev\",\"process\":{\"user\":{\"uid\":0,\"gid\":0},\"args\":[\"/bin/sh\",\"-c\",\"ln -s /usr/share/openstack-tripleo-common/healthcheck/ceilometer-agent-central /openstack/healthcheck \\u0026\\u0026 chmod a+rx /openstack/healthcheck\"],\"env\":[\"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin\",\"LANG=en_US.UTF-8\",\"container=oci\",\"HOSTNAME=eba898107bd8\"],\"cwd\":\"/\",\"capabilities\":{\"bounding\":[\"CAP_AUDIT_WRITE\",\"CAP_CHOWN\",\"CAP_DAC_OVERRIDE\",\"CAP_FOWNER\",\"CAP_FSETID\",\"CAP_KILL\",\"CAP_MKNOD\",\"CAP_NET_BIND_SERVICE\",\"CAP_NET_RAW\",\"CAP_SETFCAP\",\"CAP_SETGID\",\"CAP_SETPCAP\",\"CAP_SETUID\",\"CAP_SYS_CHROOT\"],\"effective\":[\"CAP_AUDIT_WRITE\",\"CAP_CHOWN\",\"CAP_DAC_OVERRIDE\",\"CAP_FOWNER\",\"CAP_FSETID\",\"CAP_KILL\",\"CAP_MKNOD\",\"CAP_NET_BIND_SERVICE\",\"CAP_NET_RAW\",\"CAP_SETFCAP\",\"CAP_SETGID\",\"CAP_SETPCAP\",\"CAP_SETUID\",\"CAP_SYS_CHROOT\"],\"inheritable\":[\"CAP_AUDIT_WRITE\",\"CAP_CHOWN\",\"CAP_DAC_OVERRIDE\",\"CAP_FOWNER\",\"CAP_FSETID\",\"CAP_KILL\",\"CAP_MKNOD\",\"CAP_NET_BIND_SERVICE\",\"CAP_NET_RAW\",\"CAP_SETFCAP\",\"CAP_SETGID\",\"CAP_SETPCAP\",\"CAP_SETUID\",\"CAP_SYS_CHROOT\"],\"permitted\":[\"CAP_AUDIT_WRITE\",\"CAP_CHOWN\",\"CAP_DAC_OVERRIDE\",\"CAP_FOWNER\",\"CAP_FSETID\",\"CAP_KILL\",\"CAP_MKNOD\",\"CAP_NET_BIND_SERVICE\",\"CAP_NET_RAW\",\"CAP_SETFCAP\",\"CAP_SETGID\",\"CAP_SETPCAP\",\"CAP_SETUID\",\"CAP_SYS_CHROOT\"],\"ambient\":[\"CAP_AUDIT_WRITE\",\"CAP_CHOWN\",\"CAP_DAC_OVERRIDE\",\"CAP_FOWNER\",\"CAP_FSETID\",\"CAP_KILL\",\"CAP_MKNOD\",\"CAP_NET_BIND_SERVICE\",\"CAP_NET_RAW\",\"CAP_SETFCAP\",\"CAP_SETGID\",\"CAP_SETPCAP\",\"CAP_SETUID\",\"CAP_SYS_CHROOT\"]},\"rlimits\":[{\"type\":\"RLIMIT_NOFILE\",\"hard\":1024,\"soft\":1024},{\"type\":\"RLIMIT_NPROC\",\"hard\":4194304,\"soft\":4194304}],\"selinuxLabel\":\"system_u:system_r:container_t:s0:c306,c684\"},\"root\":{\"path\":\"/var/tmp/buildah285435815/mnt/rootfs\"},\"hostname\":\"eba898107bd8\",\"mounts\":[{\"destination\":\"/etc/pki/rpm-gpg\",\"type\":\"bind\",\"source\":\"/var/tmp/buildah285435815/mnt/buildah-bind-target-0\",\"options\":[\"z\",\"rw\",\"private\",\"rbind\"]},{\"destination\":\"/etc/yum.repos.d\",\"type\":\"bind\",\"source\":\"/var/tmp/buildah285435815/mnt/buildah-bind-target-1\",\"options\":[\"z\",\"rw\",\"private\",\"rbind\"]},{\"destination\":\"/run/secrets\",\"type\":\"bind\",\"source\":\"/var/tmp/buildah285435815/mnt/buildah-bind-target-2\",\"options\":[\"bind\",\"rprivate\"]},{\"destination\":\"/etc/hosts\",\"type\":\"bind\",\"source\":\"/var/tmp/buildah285435815/hosts\",\"options\":[\"rbind\"]},{\"destination\":\"/etc/resolv.conf\",\"type\":\"bind\",\"source\":\"/var/tmp/buildah285435815/resolv.conf\",\"options\":[\"rbind\"]},{\"destination\":\"/run/.containerenv\",\"type\":\"bind\",\"source\":\"/var/tmp/buildah285435815/run/.containerenv\",\"options\":[\"rbind\"]},{\"destination\":\"/proc\",\"type\":\"proc\",\"source\":\"proc\",\"options\":[\"nosuid\",\"noexec\",\"nodev\"]},{\"destination\":\"/dev\",\"type\":\"tmpfs\",\"source\":\"tmpfs\",\"options\":[\"nosuid\",\"strictatime\",\"mode=755\",\"size=65536k\"]},{\"destination\":\"/dev/pts\",\"type\":\"devpts\",\"source\":\"devpts\",\"options\":[\"nosuid\",\"noexec\",\"newinstance\",\"ptmxmode=0666\",\"mode=0620\",\"gid=5\"]},{\"destination\":\"/dev/shm\",\"type\":\"tmpfs\",\"source\":\"shm\",\"options\":[\"nosuid\",\"noexec\",\"nodev\",\"mode=1777\",\"size=65536k\"]},{\"destination\":\"/dev/mqueue\",\"type\":\"mqueue\",\"source\":\"mqueue\",\"options\":[\"nosuid\",\"noexec\",\"nodev\"]},{\"destination\":\"/sys\",\"type\":\"sysfs\",\"source\":\"sysfs\",\"options\":[\"nosuid\",\"noexec\",\"nodev\",\"ro\"]},{\"destination\":\"/sys/fs/cgroup\",\"type\":\"cgroup\",\"source\":\"cgroup\",\"options\":[\"nosuid\",\"noexec\",\"nodev\",\"relatime\",\"ro\"]}],\"linux\":{\"resources\":{\"devices\":[{\"allow\":false,\"access\":\"rwm\"}]},\"namespaces\":[{\"type\":\"pid\"},{\"type\":\"ipc\"},{\"type\":\"uts\"},{\"type\":\"mount\"}],\"seccomp\":{\"defaultAction\":\"SCMP_ACT_ERRNO\",\"architectures\":[\"SCMP_ARCH_X86_64\",\"SCMP_ARCH_X86\",\"SCMP_ARCH_X32\"],\"syscalls\":[{\"names\":[\"accept\",\"accept4\",\"access\",\"adjtimex\",\"alarm\",\"bind\",\"brk\",\"capget\",\"capset\",\"chdir\",\"chmod\",\"chown\",\"chown32\",\"clock_adjtime\",\"clock_getres\",\"clock_gettime\",\"clock_nanosleep\",\"clone\",\"close\",\"connect\",\"copy_file_range\",\"creat\",\"dup\",\"dup2\",\"dup3\",\"epoll_create\",\"epoll_create1\",\"epoll_ctl\",\"epoll_ctl_old\",\"epoll_pwait\",\"epoll_wait\",\"epoll_wait_old\",\"eventfd\",\"eventfd2\",\"execve\",\"execveat\",\"exit\",\"exit_group\",\"faccessat\",\"fadvise64\",\"fadvise64_64\",\"fallocate\",\"fanotify_mark\",\"fchdir\",\"fchmod\",\"fchmodat\",\"fchown\",\"fchown32\",\"fchownat\",\"fcntl\",\"fcntl64\",\"fdatasync\",\"fgetxattr\",\"flistxattr\",\"flock\",\"fork\",\"fremovexattr\",\"fsetxattr\",\"fstat\",\"fstat64\",\"fstatat64\",\"fstatfs\",\"fstatfs64\",\"fsync\",\"ftruncate\",\"ftruncate64\",\"futex\",\"futimesat\",\"getcpu\",\"getcwd\",\"getdents\",\"getdents64\",\"getegid\",\"getegid32\",\"geteuid\",\"geteuid32\",\"getgid\",\"getgid32\",\"getgroups\",\"getgroups32\",\"getitimer\",\"getpeername\",\"getpgid\",\"getpgrp\",\"getpid\",\"getppid\",\"getpriority\",\"getrandom\",\"getresgid\",\"getresgid32\",\"getresuid\",\"getresuid32\",\"getrlimit\",\"get_robust_list\",\"getrusage\",\"getsid\",\"getsockname\",\"getsockopt\",\"get_thread_area\",\"gettid\",\"gettimeofday\",\"getuid\",\"getuid32\",\"getxattr\",\"inotify_add_watch\",\"inotify_init\",\"inotify_init1\",\"inotify_rm_watch\",\"io_cancel\",\"ioctl\",\"io_destroy\",\"io_getevents\",\"ioprio_get\",\"ioprio_set\",\"io_setup\",\"io_submit\",\"ipc\",\"keyctl\",\"kill\",\"lchown\",\"lchown32\",\"lgetxattr\",\"link\",\"linkat\",\"listen\",\"listxattr\",\"llistxattr\",\"_llseek\",\"lremovexattr\",\"lseek\",\"lsetxattr\",\"lstat\",\"lstat64\",\"madvise\",\"memfd_create\",\"mincore\",\"mkdir\",\"mkdirat\",\"mknod\",\"mknodat\",\"mlock\",\"mlock2\",\"mlockall\",\"mmap\",\"mmap2\",\"mprotect\",\"mq_getsetattr\",\"mq_notify\",\"mq_open\",\"mq_timedreceive\",\"mq_timedsend\",\"mq_unlink\",\"mremap\",\"msgctl\",\"msgget\",\"msgrcv\",\"msgsnd\",\"msync\",\"munlock\",\"munlockall\",\"munmap\",\"nanosleep\",\"newfstatat\",\"_newselect\",\"open\",\"openat\",\"pause\",\"pipe\",\"pipe2\",\"pivot_root\",\"poll\",\"ppoll\",\"prctl\",\"pread64\",\"preadv\",\"preadv2\",\"prlimit64\",\"pselect6\",\"pwrite64\",\"pwritev\",\"pwritev2\",\"read\",\"readahead\",\"readlink\",\"readlinkat\",\"readv\",\"recv\",\"recvfrom\",\"recvmmsg\",\"recvmsg\",\"remap_file_pages\",\"removexattr\",\"rename\",\"renameat\",\"renameat2\",\"restart_syscall\",\"rmdir\",\"rt_sigaction\",\"rt_sigpending\",\"rt_sigprocmask\",\"rt_sigqueueinfo\",\"rt_sigreturn\",\"rt_sigsuspend\",\"rt_sigtimedwait\",\"rt_tgsigqueueinfo\",\"sched_getaffinity\",\"sched_getattr\",\"sched_getparam\",\"sched_get_priority_max\",\"sched_get_priority_min\",\"sched_getscheduler\",\"sched_rr_get_interval\",\"sched_setaffinity\",\"sched_setattr\",\"sched_setparam\",\"sched_setscheduler\",\"sched_yield\",\"seccomp\",\"select\",\"semctl\",\"semget\",\"semop\",\"semtimedop\",\"send\",\"sendfile\",\"sendfile64\",\"sendmmsg\",\"sendmsg\",\"sendto\",\"setfsgid\",\"setfsgid32\",\"setfsuid\",\"setfsuid32\",\"setgid\",\"setgid32\",\"setgroups\",\"setgroups32\",\"setitimer\",\"setpgid\",\"setpriority\",\"setregid\",\"setregid32\",\"setresgid\",\"setresgid32\",\"setresuid\",\"setresuid32\",\"setreuid\",\"setreuid32\",\"setrlimit\",\"set_robust_list\",\"setsid\",\"setsockopt\",\"set_thread_area\",\"set_tid_address\",\"setuid\",\"setuid32\",\"setxattr\",\"shmat\",\"shmctl\",\"shmdt\",\"shmget\",\"shutdown\",\"sigaltstack\",\"signalfd\",\"signalfd4\",\"sigreturn\",\"socket\",\"socketcall\",\"socketpair\",\"splice\",\"stat\",\"stat64\",\"statfs\",\"statfs64\",\"statx\",\"symlink\",\"symlinkat\",\"sync\",\"sync_file_range\",\"syncfs\",\"sysinfo\",\"syslog\",\"tee\",\"tgkill\",\"time\",\"timer_create\",\"timer_delete\",\"timerfd_create\",\"timerfd_gettime\",\"timerfd_settime\",\"timer_getoverrun\",\"timer_gettime\",\"timer_settime\",\"times\",\"tkill\",\"truncate\",\"truncate64\",\"ugetrlimit\",\"umask\",\"uname\",\"unlink\",\"unlinkat\",\"utime\",\"utimensat\",\"utimes\",\"vfork\",\"vmsplice\",\"wait4\",\"waitid\",\"waitpid\",\"write\",\"writev\",\"mount\",\"umount2\",\"reboot\",\"name_to_handle_at\",\"unshare\"],\"action\":\"SCMP_ACT_ALLOW\"},{\"names\":[\"personality\"],\"action\":\"SCMP_ACT_ALLOW\",\"args\":[{\"index\":0,\"value\":0,\"op\":\"SCMP_CMP_EQ\"}]},{\"names\":[\"personality\"],\"action\":\"SCMP_ACT_ALLOW\",\"args\":[{\"index\":0,\"value\":8,\"op\":\"SCMP_CMP_EQ\"}]},{\"names\":[\"personality\"],\"action\":\"SCMP_ACT_ALLOW\",\"args\":[{\"index\":0,\"value\":131072,\"op\":\"SCMP_CMP_EQ\"}]},{\"names\":[\"personality\"],\"action\":\"SCMP_ACT_ALLOW\",\"args\":[{\"index\":0,\"value\":131080,\"op\":\"SCMP_CMP_EQ\"}]},{\"names\":[\"personality\"],\"action\":\"SCMP_ACT_ALLOW\",\"args\":[{\"index\":0,\"value\":4294967295,\"op\":\"SCMP_CMP_EQ\"}]},{\"names\":[\"arch_prctl\"],\"action\":\"SCMP_ACT_ALLOW\"},{\"names\":[\"modify_ldt\"],\"action\":\"SCMP_ACT_ALLOW\"},{\"names\":[\"clone\"],\"action\":\"SCMP_ACT_ALLOW\",\"args\":[{\"index\":0,\"value\":2080505856,\"op\":\"SCMP_CMP_MASKED_EQ\"}]},{\"names\":[\"chroot\"],\"action\":\"SCMP_ACT_ALLOW\"}]},\"maskedPaths\":[\"/proc/acpi\",\"/proc/kcore\",\"/proc/keys\",\"/proc/latency_stats\",\"/proc/timer_list\",\"/proc/timer_stats\",\"/proc/sched_debug\",\"/proc/scsi\",\"/sys/firmware\"],\"readonlyPaths\":[\"/proc/asound\",\"/proc/bus\",\"/proc/fs\",\"/proc/irq\",\"/proc/sys\",\"/proc/sysrq-trigger\"],\"mountLabel\":\"system_u:object_r:container_file_t:s0:c306,c684\"}}"
level=debug msg="Running [\"runc\" \"create\" \"--bundle\" \"/var/tmp/buildah285435815\" \"--pid-file\" \"/var/tmp/buildah285435815/pid\" \"buildah-buildah285435815\"]"
level=debug msg="Running [\"runc\" \"start\" \"buildah-buildah285435815\"]"
level=debug msg="closing stdin"
level=debug msg="Parsed Step: {Env:[PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin LANG=en_US.UTF-8 container=oci] Command:user Args:[ceilometer] Flags:[] Attrs:map[] Message:USER ceilometer Original:USER ceilometer}"
STEP 5: USER ceilometer
level=debug msg="COMMIT 127.0.0.1:5555/tripleomaster/openstack-ceilometer-central:latest-2020-08-07_19-35-07"
STEP 6: COMMIT 127.0.0.1:5555/tripleomaster/openstack-ceilometer-central:latest-2020-08-07_19-35-07
level=debug msg="parsed reference into \"[overlay@/var/lib/containers/storage+/var/run/containers/storage:overlay.mountopt=nodev,metacopy=on]127.0.0.1:5555/tripleomaster/openstack-ceilometer-central:latest-2020-08-07_19-35-07\""
level=debug msg="COMMIT \"containers-storage:[overlay@/var/lib/containers/storage+/var/run/containers/storage:overlay.mountopt=nodev,metacopy=on]127.0.0.1:5555/tripleomaster/openstack-ceilometer-central:latest-2020-08-07_19-35-07\""
level=debug msg="committing image with reference \"containers-storage:[overlay@/var/lib/containers/storage+/var/run/containers/storage:overlay.mountopt=nodev,metacopy=on]127.0.0.1:5555/tripleomaster/openstack-ceilometer-central:latest-2020-08-07_19-35-07\" is allowed by policy"
level=debug msg="parsed reference into \"[overlay@/var/lib/containers/storage+/var/run/containers/storage:overlay.mountopt=nodev,metacopy=on]@de145ab98f4771fa2f60fd8ad7e6972b38f109c0a08395efd23288365fc182b4\""
level=debug msg="base image \"de145ab98f4771fa2f60fd8ad7e6972b38f109c0a08395efd23288365fc182b4\" is already present in local storage, no need to copy its layers"
level=debug msg="layer list: [\"226bfaae015f1d5712cfced3b5b628206618eaacf72f4a44d0e4084071996319\" \"1da86dd5dbd9e4d52991b5846320796527b223a8bc5c770caa644281a94fd828\" \"a78801a6333f213f31885b46d625277bfb59a6c82b5c21769813eff988e89cd4\" \"6c31d4a3ec3cd61615c990ca478b81822ae77b235c6e3018a6784e3035e8261d\" \"2a347256227b092dcd3f7225f1237f480cb350c3573cff3d34d8b70ee9919b41\" \"d479d05fece5300915b192c28ea04540ea43e93a0a9cc298c48dee46814161c1\"]"
level=debug msg="using \"/var/tmp/buildah068411408\" to hold temporary data"
mwhahaha commented 4 years ago

Just to point out it's failing on random layers (e.g. not just USER commands)

Command: sudo buildah --debug bud --volume /etc/yum.repos.d:/etc/yum.repos.d:z --volume /etc/pki/rpm-gpg:/etc/pki/rpm-gpg:z --volume /home/centos/repos:/etc/yum.repos.d:z --volume /etc/pki/rpm-gpg:/etc/pki/rpm-gpg:z --format docker --tls-verify=False --logfile /tmp/container-builds/12548e54-0011-446f-b954-4396e316e180/base/os/novajoin-base/novajoin-notifier/novajoin-notifier-build.log -t 127.0.0.1:5000/tripleomaster/openstack-novajoin-notifier:latest-2020-08-07_17-13-21 /tmp/container-builds/12548e54-0011-446f-b954-4396e316e180/base/os/novajoin-base/novajoin-notifier Exit code: 125 Stdout: '' Stderr: 'level=debug msg="Pull Policy for pull [PullIfNewer]"\nerror committing container for step {Env:[PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin LANG=en_US.UTF-8 container=oci] Command:run Args:[mkdir -p /novajoin-notifier] Flags:[] Attrs:map[] Message:RUN mkdir -p /novajoin-notifier Original:RUN mkdir -p /novajoin-notifier}: error copying layers and metadata for container "cd9d22afbf421bf69b6dcc2964c8058e62a08a78b3b2ac4506ef01b01f5aede7": Error initializing source containers-storage:127.0.0.1-working-container-2: error extracting layer "06010a75ad19efd6060a2939f597e501f1f3ca013cf608843f34258f3344ca3f": no such file or directory\n

rhatdan commented 4 years ago

Do you have the contents of the Containerfile/Dockerfile?

mwhahaha commented 4 years ago

ceilometer-central Dockerfile

# Copyright 2020 Red Hat, Inc.
# All Rights Reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License"); you may
# not use this file except in compliance with the License. You may obtain
# a copy of the License at
#
#     http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
# WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
# License for the specific language governing permissions and limitations
# under the License.

FROM 127.0.0.1:5555/tripleomaster/openstack-ceilometer-base:latest-2020-08-07_19-35-07
RUN if [ 'centos' == 'rhel' ]; then dnf module -y disable virt:rhel; dnf module -y enable virt:8.2; fi
RUN dnf -y install openstack-ceilometer-central && dnf clean all && rm -rf /var/cache/dnf
RUN ln -s /usr/share/openstack-tripleo-common/healthcheck/ceilometer-agent-central /openstack/healthcheck && chmod a+rx /openstack/healthcheck
USER ceilometer

novajoin-notifier Dockerfile

# Copyright 2020 Red Hat, Inc.
# All Rights Reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License"); you may
# not use this file except in compliance with the License. You may obtain
# a copy of the License at
#
#     http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
# WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
# License for the specific language governing permissions and limitations
# under the License.

FROM 127.0.0.1:5555/tripleomaster/openstack-novajoin-base:latest-2020-08-07_19-35-07
RUN mkdir -p /novajoin-notifier

It appears that the command is the last one of the file so I guess it's when it's writing out the last item?

Surm4 commented 4 years ago

Got the same problem on CentOS, no problems on Ubuntu

STEP 16: RUN eval $(ssh-agent -s) Agent pid 7 Error: error committing container for step STEP Command:run Args:[eval $(ssh-agent -s)] Flags:[] Attrs:map[] Message:RUN eval $(ssh-agent -s) Original:RUN eval $(ssh-agent -s)}: error copying layers and metadata for container "HASH": Error initializing source containers-storage:HASH-working-container: error extracting layer "HASH": no such device or address

rhatdan commented 4 years ago

@ashley-cui PTAL

sshnaidm commented 3 years ago

I think I hit the same in #2727

sshnaidm commented 3 years ago

@rhatdan any updates on that?

rhatdan commented 3 years ago

Nope, what version of Buildah and what distro is this happening on?

rhatdan commented 3 years ago

Do you have a repeater or is it random?

sshnaidm commented 3 years ago

@rhatdan CentOS 8 and buildah versions are in bug description, right now we use buildah-1.11.6-7.module_el8.2.0+458+dab581ed.x86_64, also happens with later versions like 14 etc. It's pretty random, but because we run now building containers in buildah in CI it affects about 15% or our jobs. I think while running it in loop pretty easy to get this error.

rhatdan commented 3 years ago

I would love to know if buildah 1.16 still has the issue. This version should be available to Centos 8 soon. @nalind Thoughts?

lsm5 commented 3 years ago

buildah 1.19.0 is already available on CentOS Stream.

buildah 1.19.2 is available on the Kubic project repos.

Regular CentOS8 only has 1.15.1 and older, and my estimate for buildah 1.16 to land on it would be mid-March. So, if you can't wait until then, might be worth trying out Stream or Kubic.

nalind commented 3 years ago

The "no such file or directory" error looks like the one that led to #2500, which was fixed in 1.16 and then backported for 1.15.2 and 1.14.11.

lsm5 commented 3 years ago

The "no such file or directory" error looks like the one that led to #2500, which was fixed in 1.16 and then backported for 1.15.2 and 1.14.11.

Sorry, to be specific RE: my earlier comment about 1.15.1 and older, CentOS 8.3.2011 only has 1.15.1 and 1.11.6 which would be a no-go :(

rhatdan commented 3 years ago

We believe this is fixed in 1.19.* which is the current release. If you get the error there, then reopen the issue. Centos 8 Stream should be getting this version soon. RHEL8.4 and Centos 8.4 will also get it.

alapidas commented 3 years ago

I am seeing this on 1.20.0-dev

[root@59fcf9439f0a /]# buildah version
Version:         1.20.0-dev
Go Version:      go1.16
Image Spec:      1.0.1-dev
Runtime Spec:    1.0.2-dev
CNI Spec:        0.4.0
libcni Version:
image Version:   5.10.3
Git Commit:
Built:           Thu Jan  1 00:00:00 1970
OS/Arch:         linux/amd64
yevgeny-z commented 3 years ago

Have same problems with parallel builds with Centos 7, overlay.mount_program=/usr/bin/fuse-overlayfs and latest buildah from main branch

# buildah version
Version:         1.22.0-dev
Go Version:      go1.15.5
Image Spec:      1.0.1-dev
Runtime Spec:    1.0.2-dev
CNI Spec:        0.4.0
libcni Version:  v0.8.1
image Version:   5.13.2
Git Commit:      8c56a15
Built:           Wed Jul 21 19:35:54 2021
OS/Arch:         linux/amd64
error committing container for step X: 
error copying layers and metadata for container "e160e3c69b84881c2feeba2df6daca9a6184320c9855a3c49682880929693c1b": 
Error initializing source containers-storage:X-working-container-2: 
error extracting layer "07d7a4430d68d90b92cd9e56ba75119200399d4469a31467567bc3a1afdcd36f": 
llistxattr /var/lib/containers/storage/overlay/399498608a7c394205af643c5ff7551c5271d9653b89e27c651e05d2e9a1c433/merged/opt/java/openjdk/bin: 
no such file or directory
rhatdan commented 3 years ago

You probably need an updated version of fuse-overlay. Would be better to run this on RHEL8, RHEL7 is not supported with newer stuff.