search

apache / arrow

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
https://arrow.apache.org/
Apache License 2.0
14.69k stars 3.56k forks source link

[Packaging][Release] centos-9 on arm64 is failing #44422

Closed raulcd closed 1 month ago

raulcd commented 1 month ago

Describe the bug, including details regarding any error messages, version, and platform.

The centos-9-stream-arm64 job is failing consistently testing with:

   ++ arch
  + release_path+=/9-stream/aarch64/Packages
  + release_path+=/apache-arrow-release-18.0.0.dev453-1.el9.noarch.rpm
  + dnf install -y --enablerepo=crb /host/dev/release/../../dev/tasks/linux-packages/yum/repositories/centos/9-stream/aarch64/Packages/apache-arrow-release-18.0.0.dev453-1.el9.noarch.rpm
  CentOS Stream 9 - BaseOS                         14 MB/s | 9.4 MB     00:00    
  CentOS Stream 9 - AppStream                     770  B/s | 4.4 kB     00:05    
  Errors during downloading metadata for repository 'appstream':
    - Downloading successful, but checksum doesn't match. Calculated: ef16d195332d673efbe2fc9a316726df177a605e1caef3ca49f88a7181f973654347400cb50ee464dd7206fc9a59c34cf37d0baea158add0bde531cb7cab8039(sha512)  Expected: b2b0cdc3fdc6021ff6ddd33a4b508daa7050cc8cdfca7dd9aa6c854ed80dd39b4fd5bfa6e66db2c37e0ad25cee9f53e7b24b84d7f302f2ca07198439524d1c99(sha512) 
  Error: Failed to download metadata for repo 'appstream': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried
  rake aborted!

This is happening on the maintenance branch for 18.0.0. I've retried the job there several times, see: https://github.com/ursacomputing/crossbow/actions/runs/11344859386 It fails consistently.

Component(s)

Packaging, Release

raulcd commented 1 month ago

A new issue has appeared :( @kou any idea?

kou commented 1 month ago

It seems that the current quay.io/centos/centos:stream9 for linux/aarch64 is broken`:

$ docker run --platform linux/aarch64 -it --rm quay.io/centos/centos:stream9
[root@2fec18b5cf70 /]# dnf update -y
CentOS Stream 9 - BaseOS                                                                             2.8 MB/s | 9.4 MB     00:03    
CentOS Stream 9 - AppStream                                                                          161  B/s | 4.4 kB     00:27    
Errors during downloading metadata for repository 'appstream':
  - Downloading successful, but checksum doesn't match. Calculated: ef16d195332d673efbe2fc9a316726df177a605e1caef3ca49f88a7181f973654347400cb50ee464dd7206fc9a59c34cf37d0baea158add0bde531cb7cab8039(sha512)  Expected: b2b0cdc3fdc6021ff6ddd33a4b508daa7050cc8cdfca7dd9aa6c854ed80dd39b4fd5bfa6e66db2c37e0ad25cee9f53e7b24b84d7f302f2ca07198439524d1c99(sha512) 
Error: Failed to download metadata for repo 'appstream': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried

Fortunately, the broken image is used only for test. We use cached (a bit old) image for build. So we can build RPM for CentOS Stream 9.

How about uploading built RPMs before test? GH-44425

The job is still failing but we can use the built RPMs for 18.0.0.

raulcd commented 1 month ago

Issue resolved by pull request 44425 https://github.com/apache/arrow/pull/44425

raulcd commented 1 month ago

I've created this as a follow up to revert the change: https://github.com/apache/arrow/issues/44439