ansible / awx-ee

An Ansible execution environment for AWX project
https://quay.io/ansible/awx-ee
Other
132 stars 158 forks source link

Build process currently seem broken / Problem: package centos-stream-repos-8-4.el8.noarch #109

Closed paladine-raistlin closed 2 years ago

paladine-raistlin commented 2 years ago
awx:~/awx-ee# tox -edocker
docker create: /root/awx-ee/.tox/docker
docker installdeps: -r/root/awx-ee/requirements.txt
docker installed: ansible-builder @ git+https://github.com/ansible/ansible-builder.git@db9e74a0b66aa4b535bf6946c5288f1c2619c133,bindep==2.10.2,distro==1.7.0,packaging==21.3,Parsley==1.3,pbr==5.8.1,pyparsing==3.0.7,PyYAML==6.0,requirements-parser==0.5.0,types-setuptools==57.4.11
docker run-test-pre: PYTHONHASHSEED='303857441'
docker run-test: commands[0] | /bin/bash -c 'podman rmi quay.io/ansible/awx-ee:latest || true'
/bin/bash: line 1: podman: command not found
docker run-test: commands[1] | ansible-builder build -v3 -c . -t quay.io/ansible/awx-ee --container-runtime=docker
Ansible Builder is building your execution environment image. Tags: quay.io/ansible/awx-ee
File ./_build/requirements.yml was placed in build context by user, leaving unmodified.
File ./_build/bindep.txt was placed in build context by user, leaving unmodified.
Rewriting Containerfile to capture collection requirements
Running command:
  docker build -f ./Dockerfile -t quay.io/ansible/awx-ee .
Sending build context to Docker daemon  21.37MB
Step 1/26 : ARG EE_BASE_IMAGE=quay.io/ansible/ansible-runner:stable-2.12-devel
Step 2/26 : ARG EE_BUILDER_IMAGE=quay.io/ansible/ansible-builder:latest
Step 3/26 : FROM $EE_BASE_IMAGE as galaxy
stable-2.12-devel: Pulling from ansible/ansible-runner
fdc12ef68aee: Already exists
998ceb85f375: Already exists
45081c646f63: Already exists
b0eb4fd5a26a: Already exists
6c569ba3ed4d: Pulling fs layer
62fa4cf563ab: Pulling fs layer
d5b10f3441e1: Pulling fs layer
d777af3f4a5e: Pulling fs layer
a8d40afdc5f2: Pulling fs layer
8e05686aad27: Pulling fs layer
c135176e631c: Pulling fs layer
c73fae58d3fe: Pulling fs layer
bf617b66c403: Pulling fs layer
05affca58bee: Pulling fs layer
a959e235a6df: Pulling fs layer
bda8e1011014: Pulling fs layer
079be403c54f: Pulling fs layer
c73fae58d3fe: Waiting
bda8e1011014: Waiting
079be403c54f: Waiting
bf617b66c403: Waiting
a959e235a6df: Waiting
05affca58bee: Waiting
8e05686aad27: Waiting
d777af3f4a5e: Waiting
a8d40afdc5f2: Waiting
c135176e631c: Waiting
62fa4cf563ab: Download complete
6c569ba3ed4d: Verifying Checksum
6c569ba3ed4d: Download complete
6c569ba3ed4d: Pull complete
62fa4cf563ab: Pull complete
a8d40afdc5f2: Download complete
d5b10f3441e1: Download complete
d777af3f4a5e: Verifying Checksum
d777af3f4a5e: Download complete
8e05686aad27: Verifying Checksum
8e05686aad27: Download complete
c135176e631c: Download complete
c73fae58d3fe: Download complete
a959e235a6df: Verifying Checksum
a959e235a6df: Download complete
d5b10f3441e1: Pull complete
bda8e1011014: Verifying Checksum
bda8e1011014: Download complete
bf617b66c403: Verifying Checksum
bf617b66c403: Download complete
079be403c54f: Verifying Checksum
079be403c54f: Download complete
05affca58bee: Verifying Checksum
05affca58bee: Download complete
d777af3f4a5e: Pull complete
a8d40afdc5f2: Pull complete
8e05686aad27: Pull complete
c135176e631c: Pull complete
c73fae58d3fe: Pull complete
bf617b66c403: Pull complete
05affca58bee: Pull complete
a959e235a6df: Pull complete
bda8e1011014: Pull complete
079be403c54f: Pull complete
Digest: sha256:cd9366c5c63dde3024a2efc75f4a1f72cd804a7f8d4820895b5601f4bba1cbd2
Status: Downloaded newer image for quay.io/ansible/ansible-runner:stable-2.12-devel
 ---> fd665cf7bb6a
Step 4/26 : ARG ANSIBLE_GALAXY_CLI_COLLECTION_OPTS=
 ---> Running in 7ac4a0f89838
Removing intermediate container 7ac4a0f89838
 ---> 07050da6e072
Step 5/26 : USER root
 ---> Running in 4ab9ca859339
Removing intermediate container 4ab9ca859339
 ---> bdea9cb2a84d
Step 6/26 : ADD _build /build
 ---> 46353d6c2a33
Step 7/26 : WORKDIR /build
 ---> Running in fcb7cd0986a2
Removing intermediate container fcb7cd0986a2
 ---> 8aa437aa7bfa
Step 8/26 : RUN ansible-galaxy role install -r requirements.yml --roles-path /usr/share/ansible/roles
 ---> Running in 0912b9ae75bf
Skipping install, no requirements found
Removing intermediate container 0912b9ae75bf
 ---> afeaafd5a7d4
Step 9/26 : RUN ansible-galaxy collection install $ANSIBLE_GALAXY_CLI_COLLECTION_OPTS -r requirements.yml --collections-path /usr/share/ansible/collections
 ---> Running in 6f1c63fb55c1
Starting galaxy collection install process
Process install dependency map
Starting collection install process
Downloading https://galaxy.ansible.com/download/redhatinsights-insights-1.0.7.tar.gz to /home/runner/.ansible/tmp/ansible-local-1ujcdjige/tmpnstch09g/redhatinsights-insights-1.0.7-95132bpz
Installing 'redhatinsights.insights:1.0.7' to '/usr/share/ansible/collections/ansible_collections/redhatinsights/insights'
redhatinsights.insights:1.0.7 was installed successfully
Downloading https://galaxy.ansible.com/download/ansible-posix-1.3.0.tar.gz to /home/runner/.ansible/tmp/ansible-local-1ujcdjige/tmpnstch09g/ansible-posix-1.3.0-eenffwhi
Installing 'ansible.posix:1.3.0' to '/usr/share/ansible/collections/ansible_collections/ansible/posix'
ansible.posix:1.3.0 was installed successfully
Downloading https://galaxy.ansible.com/download/google-cloud-1.0.2.tar.gz to /home/runner/.ansible/tmp/ansible-local-1ujcdjige/tmpnstch09g/google-cloud-1.0.2-3warlp2h
Installing 'google.cloud:1.0.2' to '/usr/share/ansible/collections/ansible_collections/google/cloud'
google.cloud:1.0.2 was installed successfully
Downloading https://galaxy.ansible.com/download/openstack-cloud-1.7.2.tar.gz to /home/runner/.ansible/tmp/ansible-local-1ujcdjige/tmpnstch09g/openstack-cloud-1.7.2-qvdm1sw1
Installing 'openstack.cloud:1.7.2' to '/usr/share/ansible/collections/ansible_collections/openstack/cloud'
openstack.cloud:1.7.2 was installed successfully
Downloading https://galaxy.ansible.com/download/kubernetes-core-2.3.0.tar.gz to /home/runner/.ansible/tmp/ansible-local-1ujcdjige/tmpnstch09g/kubernetes-core-2.3.0-ohu75x0p
Installing 'kubernetes.core:2.3.0' to '/usr/share/ansible/collections/ansible_collections/kubernetes/core'
kubernetes.core:2.3.0 was installed successfully
Downloading https://galaxy.ansible.com/download/ansible-windows-1.9.0.tar.gz to /home/runner/.ansible/tmp/ansible-local-1ujcdjige/tmpnstch09g/ansible-windows-1.9.0-nw9y0wme
Installing 'ansible.windows:1.9.0' to '/usr/share/ansible/collections/ansible_collections/ansible/windows'
ansible.windows:1.9.0 was installed successfully
Downloading https://galaxy.ansible.com/download/amazon-aws-3.1.1.tar.gz to /home/runner/.ansible/tmp/ansible-local-1ujcdjige/tmpnstch09g/amazon-aws-3.1.1-d7m29nwq
Installing 'amazon.aws:3.1.1' to '/usr/share/ansible/collections/ansible_collections/amazon/aws'
amazon.aws:3.1.1 was installed successfully
Downloading https://galaxy.ansible.com/download/azure-azcollection-1.12.0.tar.gz to /home/runner/.ansible/tmp/ansible-local-1ujcdjige/tmpnstch09g/azure-azcollection-1.12.0-vmz3w9_k
Installing 'azure.azcollection:1.12.0' to '/usr/share/ansible/collections/ansible_collections/azure/azcollection'
azure.azcollection:1.12.0 was installed successfully
Downloading https://galaxy.ansible.com/download/community-vmware-2.1.0.tar.gz to /home/runner/.ansible/tmp/ansible-local-1ujcdjige/tmpnstch09g/community-vmware-2.1.0-zjxqm4fr
Installing 'community.vmware:2.1.0' to '/usr/share/ansible/collections/ansible_collections/community/vmware'
community.vmware:2.1.0 was installed successfully
Downloading https://galaxy.ansible.com/download/theforeman-foreman-3.2.0.tar.gz to /home/runner/.ansible/tmp/ansible-local-1ujcdjige/tmpnstch09g/theforeman-foreman-3.2.0-b_r3mg_u
Installing 'theforeman.foreman:3.2.0' to '/usr/share/ansible/collections/ansible_collections/theforeman/foreman'
theforeman.foreman:3.2.0 was installed successfully
Downloading https://galaxy.ansible.com/download/ovirt-ovirt-1.6.6.tar.gz to /home/runner/.ansible/tmp/ansible-local-1ujcdjige/tmpnstch09g/ovirt-ovirt-1.6.6-3mf79pwm
Installing 'ovirt.ovirt:1.6.6' to '/usr/share/ansible/collections/ansible_collections/ovirt/ovirt'
ovirt.ovirt:1.6.6 was installed successfully
Downloading https://galaxy.ansible.com/download/awx-awx-20.0.1.tar.gz to /home/runner/.ansible/tmp/ansible-local-1ujcdjige/tmpnstch09g/awx-awx-20.0.1-ccprv783
Installing 'awx.awx:20.0.1' to '/usr/share/ansible/collections/ansible_collections/awx/awx'
awx.awx:20.0.1 was installed successfully
Removing intermediate container 6f1c63fb55c1
 ---> 9910d7caa8bc
Step 10/26 : FROM $EE_BUILDER_IMAGE as builder
 ---> b0348faa7f41
Step 11/26 : COPY --from=galaxy /usr/share/ansible /usr/share/ansible
 ---> faef7eb00729
Step 12/26 : ADD _build/bindep.txt bindep.txt
 ---> 80ecdf5d9115
Step 13/26 : RUN ansible-builder introspect --sanitize --user-bindep=bindep.txt --write-bindep=/tmp/src/bindep.txt --write-pip=/tmp/src/requirements.txt
 ---> Running in aac05262dbd0
# Sanitized dependencies for /usr/share/ansible/collections
---
python:
- 'botocore>=1.19.0  # from collection amazon.aws'
- 'boto3>=1.16.0  # from collection amazon.aws'
- 'boto>=2.49.0  # from collection amazon.aws'
- 'pytz  # from collection awx.awx'
- 'python-dateutil>=2.7.0  # from collection awx.awx'
- 'awxkit  # from collection awx.awx'
- 'packaging  # from collection azure.azcollection'
- 'requests>=2.4.2  # from collection azure.azcollection,google.cloud,redhatinsights.insights,theforeman.foreman'
- 'xmltodict  # from collection azure.azcollection'
- 'azure-cli-core==2.34.0  # from collection azure.azcollection'
- 'azure-common==1.1.11  # from collection azure.azcollection'
- 'azure-identity==1.7.0  # from collection azure.azcollection'
- 'azure-mgmt-apimanagement==0.2.0  # from collection azure.azcollection'
- 'azure-mgmt-authorization==0.51.1  # from collection azure.azcollection'
- 'azure-mgmt-batch==5.0.1  # from collection azure.azcollection'
- 'azure-mgmt-cdn==3.0.0  # from collection azure.azcollection'
- 'azure-mgmt-compute==23.1.0  # from collection azure.azcollection'
- 'azure-mgmt-containerinstance==1.4.0  # from collection azure.azcollection'
- 'azure-mgmt-containerregistry==2.0.0  # from collection azure.azcollection'
- 'azure-mgmt-containerservice==9.1.0  # from collection azure.azcollection'
- 'azure-mgmt-datalake-store==0.5.0  # from collection azure.azcollection'
- 'azure-mgmt-dns==2.1.0  # from collection azure.azcollection'
- 'azure-mgmt-keyvault==1.1.0  # from collection azure.azcollection'
- 'azure-mgmt-marketplaceordering==0.1.0  # from collection azure.azcollection'
- 'azure-mgmt-monitor==3.0.0  # from collection azure.azcollection'
- 'azure-mgmt-managedservices==1.0.0  # from collection azure.azcollection'
- 'azure-mgmt-managementgroups==0.2.0  # from collection azure.azcollection'
- 'azure-mgmt-network==19.1.0  # from collection azure.azcollection'
- 'azure-mgmt-nspkg==2.0.0  # from collection azure.azcollection'
- 'azure-mgmt-privatedns==0.1.0  # from collection azure.azcollection'
- 'azure-mgmt-redis==5.0.0  # from collection azure.azcollection'
- 'azure-mgmt-resource==10.2.0  # from collection azure.azcollection'
- 'azure-mgmt-rdbms==1.9.0  # from collection azure.azcollection'
- 'azure-mgmt-search==3.0.0  # from collection azure.azcollection'
- 'azure-mgmt-servicebus==0.5.3  # from collection azure.azcollection'
- 'azure-mgmt-sql==0.10.0  # from collection azure.azcollection'
- 'azure-mgmt-storage==19.0.0  # from collection azure.azcollection'
- 'azure-mgmt-trafficmanager==0.50.0  # from collection azure.azcollection'
- 'azure-mgmt-web==0.41.0  # from collection azure.azcollection'
- 'azure-nspkg==2.0.0  # from collection azure.azcollection'
- 'azure-storage==0.35.1  # from collection azure.azcollection'
- 'msrest==0.6.21  # from collection azure.azcollection'
- 'msrestazure==0.6.4  # from collection azure.azcollection'
- 'azure-keyvault==1.0.0a1  # from collection azure.azcollection'
- 'azure-graphrbac==0.61.1  # from collection azure.azcollection'
- 'azure-mgmt-cosmosdb==0.5.2  # from collection azure.azcollection'
- 'azure-mgmt-hdinsight==0.1.0  # from collection azure.azcollection'
- 'azure-mgmt-devtestlabs==3.0.0  # from collection azure.azcollection'
- 'azure-mgmt-loganalytics==1.0.0  # from collection azure.azcollection'
- 'azure-mgmt-automation==0.1.1  # from collection azure.azcollection'
- 'azure-mgmt-iothub==0.7.0  # from collection azure.azcollection'
- 'azure-mgmt-recoveryservices==0.4.0  # from collection azure.azcollection'
- 'azure-mgmt-recoveryservicesbackup==0.6.0  # from collection azure.azcollection'
- 'azure-mgmt-notificationhubs==2.0.0  # from collection azure.azcollection'
- 'azure-mgmt-eventhub==2.0.0  # from collection azure.azcollection'
- 'pyVmomi>=6.7  # from collection community.vmware'
- 'git+https://github.com/vmware/vsphere-automation-sdk-python.git ; python_version
  >= ''2.7''  # Python 2.6 is not supported  # from collection community.vmware'
- 'google-auth  # from collection google.cloud'
- 'kubernetes>=12.0.0  # from collection kubernetes.core'
- 'requests-oauthlib  # from collection kubernetes.core'
- 'jsonpatch  # from collection kubernetes.core'
- 'openstacksdk>=0.13  # from collection openstack.cloud'
- 'ovirt-engine-sdk-python>=4.4.11  # from collection ovirt.ovirt'
- 'ipaddress  # from collection theforeman.foreman'
system:
- 'openssl [test platform:rpm]  # from collection amazon.aws'
- 'gcc [test platform:rpm]  # from collection amazon.aws'
- 'python3-devel [test platform:rpm]  # from collection amazon.aws'
- 'python38-pytz [platform:centos-8 platform:rhel-8]  # from collection awx.awx'
- 'python38-requests [platform:centos-8 platform:rhel-8]  # from collection awx.awx,
  openstack.cloud, redhatinsights.insights'
- 'python38-pyyaml [platform:centos-8 platform:rhel-8]  # from collection awx.awx'
- 'kubernetes-client [platform:fedora]  # from collection kubernetes.core'
- 'openshift-clients [platform:rhel-8]  # from collection kubernetes.core'
- 'gcc [compile platform:centos-8 platform:rhel-8]  # from collection openstack.cloud,
  ovirt.ovirt'
- 'python38-cryptography [platform:centos-8 platform:rhel-8]  # from collection openstack.cloud'
- 'python38-devel [compile platform:centos-8 platform:rhel-8]  # from collection openstack.cloud,
  ovirt.ovirt'
- 'libcurl-devel [compile platform:centos-8 platform:rhel-8]  # from collection ovirt.ovirt'
- 'libxml2-devel [compile platform:centos-8 platform:rhel-8]  # from collection ovirt.ovirt'
- 'openssl-devel [compile platform:centos-8 platform:rhel-8]  # from collection ovirt.ovirt'
- 'qemu-img [platform:centos-8 platform:rhel-8]  # from collection ovirt.ovirt'
- 'python3-rpm [(platform:redhat platform:base-py3)]  # from collection theforeman.foreman'
- 'rpm-python [(platform:redhat platform:base-py2)]  # from collection theforeman.foreman'
- 'python38-devel [platform:rpm compile]  # from collection user'
- 'subversion [platform:rpm]  # from collection user'
- 'subversion [platform:dpkg]  # from collection user'
- 'git-lfs [platform:rpm]  # from collection user'

Creating parent directory for /tmp/src/requirements.txt
Removing intermediate container aac05262dbd0
 ---> 42f61f55736b
Step 14/26 : RUN assemble
 ---> Running in ffaa31b172a8
++ source /etc/os-release
+++ NAME='CentOS Stream'
+++ VERSION=8
+++ ID=centos
+++ ID_LIKE='rhel fedora'
+++ VERSION_ID=8
+++ PLATFORM_ID=platform:el8
+++ PRETTY_NAME='CentOS Stream 8'
+++ ANSI_COLOR='0;31'
+++ CPE_NAME=cpe:/o:centos:centos:8
+++ HOME_URL=https://centos.org/
+++ BUG_REPORT_URL=https://bugzilla.redhat.com/
+++ REDHAT_SUPPORT_PRODUCT='Red Hat Enterprise Linux 8'
+++ REDHAT_SUPPORT_PRODUCT_VERSION='CentOS Stream'
++ echo centos
+ RELEASE=centos
+ PKGMGR=
+ PKGMGR_OPTS=
+ '[' -z ']'
+ PKGMGR=/usr/bin/dnf
+ '[' -f /usr/bin/microdnf ']'
+ mkdir -p /output/bindep
+ mkdir -p /output/wheels
+ mkdir -p /tmp/src
+ cd /tmp/src
+ /usr/bin/dnf update -y
CentOS Stream 8 - AppStream                     2.6 MB/s |  21 MB     00:07    
CentOS Stream 8 - BaseOS                        8.4 MB/s |  20 MB     00:02    
CentOS Stream 8 - Extras                         36 kB/s |  18 kB     00:00    
CentOS Stream 8 - PowerTools                    430 kB/s | 4.4 MB     00:10    
Extra Packages for Enterprise Linux Modular 8 - 1.1 MB/s | 1.0 MB     00:00    
Error: 
 Problem: package centos-stream-repos-8-4.el8.noarch requires centos-gpg-keys = 1:8-4.el8, but none of the providers can be installed
  - cannot install both centos-gpg-keys-1:8-5.el8.noarch and centos-gpg-keys-1:8-4.el8.noarch
  - cannot install the best update candidate for package centos-stream-repos-8-4.el8.noarch
  - cannot install the best update candidate for package centos-gpg-keys-1:8-4.el8.noarch
(try to add '--allowerasing' to command line to replace conflicting packages or '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate packages)
The command '/bin/sh -c assemble' returned a non-zero code: 1

An error occured (rc=1), see output line(s) above for details.
ERROR: InvocationError for command /root/awx-ee/.tox/docker/bin/ansible-builder build -v3 -c . -t quay.io/ansible/awx-ee --container-runtime=docker (exited with code 1)
_______________________________________________________ summary _______________________________________________________
ERROR:   docker: commands failed
chapai518 commented 2 years ago

I faced the same problem. If you add a separate RUN and try to install a package in it, the error will be the same. This is solved by adding --nobest to the command, but I don’t understand what assemble is and how to substitute --nobest into it

chapai518 commented 2 years ago

Probably the bug in the assembler has already been fixed, after cleaning all the old images, the assembly was correct.