zextras / reposync

A tool to sync Debian and RedHat repositories with S3
GNU Affero General Public License v3.0
6 stars 2 forks source link

Hash Validation Failure although hash in repodata OK #1

Open WaywardWizard opened 5 days ago

WaywardWizard commented 5 days ago

Attempting to use reposync to mirror centos stream 9 hyperscale repository. Fails on hash validation for the first package. Manually checking hash in repodata it is correct.

Error message

starting synchronization of centos-stream9-hyperscale
requesting: https://mirror.stream.centos.org/SIGs/9-stream/hyperscale/x86_64/packages-main/repodata/repomd.xml
requesting: https://mirror.stream.centos.org/SIGs/9-stream/hyperscale/x86_64/packages-main/repodata/repomd.xml.asc
requesting: https://mirror.stream.centos.org/SIGs/9-stream/hyperscale/x86_64/packages-main/repodata/0b89ae80c64991eae41eedddbd4f3d1d728262722897a953b35f681d25fad1c4-primary.xml.gz
requesting: https://mirror.stream.centos.org/SIGs/9-stream/hyperscale/x86_64/packages-main/repodata/3b4bcc265f4fb527b79119ba8aaeae3f250b1a6226f1e3870d2c8fa0ae3b12d2-filelists.xml.gz
requesting: https://mirror.stream.centos.org/SIGs/9-stream/hyperscale/x86_64/packages-main/repodata/6e4bf955d77ab55cb67498afc21101999cc5ffafc32819928b4324bf3fff6c0e-other.xml.gz
requesting: https://mirror.stream.centos.org/SIGs/9-stream/hyperscale/x86_64/packages-main/repodata/abf1d0a5bb56d4f845f733e4a6954202bbda8c813d46091a49d05aa964ec5f73-primary.sqlite.bz2
requesting: https://mirror.stream.centos.org/SIGs/9-stream/hyperscale/x86_64/packages-main/repodata/2620f558da17a5114070866eb41dfa310ee72bca04aee7c53d6d15cfd9c2d92c-filelists.sqlite.bz2
requesting: https://mirror.stream.centos.org/SIGs/9-stream/hyperscale/x86_64/packages-main/repodata/778814f1f42e0515f9b04dca6d6d735af32cf2017d93e8e95952f58708168e90-other.sqlite.bz2
826 packages and 8 indexes to copy or update for a total of 1881.05 MB.
0 packages and 0 indexes to delete.
sync operation is atomic, either it's fully completed or will be performed from scratch
requesting: https://mirror.stream.centos.org/SIGs/9-stream/hyperscale/x86_64/packages-main/Packages/a/amd-gpu-firmware-20230919-4.hs.el9.noarch.rpm
failed to synchronize centos-stream9-hyperscale: failed to copy https://mirror.stream.centos.org/SIGs/9-stream/hyperscale/x86_64/packages-main to local: failed hash validation for 'Packages/a/amd-gpu-firmware-20230919-4.hs.el9.noarch.rpm'

Configuration

---
general:
  data_path: "/srv/repo/.reposync/data"
  tmp_path: "/srv/repo/tmp/"
  bind_address: "127.0.0.1:8080"
  timeout: 60
  max_retries: 3
  retry_sleep: 5
  min_sync_delay: 5
  max_sync_delay: 30
repo:
  - name: centos-stream9-hyperscale
    source:
      kind: redhat
      endpoint: "https://mirror.stream.centos.org/SIGs/9-stream/hyperscale/x86_64/packages-main/"
      public_pgp_key: |
        -----BEGIN PGP PUBLIC KEY BLOCK-----

        Version: GnuPG v2.0.22 (GNU/Linux)
        mQENBGAFPdEBCADhXtzOEQcQnug15GHYeYIA9Nw/x96b4XliZFi2GDT7Jqu6njA8
        QJtKm8C4Hoc/DxOXcidxDJ/pu2pYwzxRpuIi0K7PA5lF08HgF7aZsxq0yiFRMCaS
        qpp4NCw/Xj0VPohu7jICQhzalnfZjTk0zEneBnpE6jCSIDLdaH8+iC5F2KerEPjq
        +SZOH/aVLdFVgPUbz7zwL7XMsmDT0M22J1zO4QmUTsVbkaqtSwtl/qkl3Eo2hF1x
        ToiYa6CPn2rNnNUZ1xhW2l/hncE9w/kbmzALFKHEo+XUbKsihfp0UAenxNtm0k6E
        FDQTZpJet/nIq+6t3LFmZiFJl8mcIaXm3o95ABEBAAG0ZUNlbnRPUyBIeXBlclNj
        YWxlIFNJRyAoaHR0cHM6Ly93aWtpLmNlbnRvcy5vcmcvU3BlY2lhbEludGVyZXN0
        R3JvdXAvSHlwZXJzY2FsZSkgPHNlY3VyaXR5QGNlbnRvcy5vcmc+iQE5BBMBCgAj
        AhsDBwsJCAcDAgEGFQgCCQoLBBYCAwECHgECF4AFAmIgawoACgkQKgH6Kus9rEDB
        5QgAk7U2F8HGcaC3FXdqHzkqsz0gFZ0gpJ+QSVJphiCSTpBLzerFZEDD64igXOLi
        qL5OW8fJrKBqKeGCT/VRV3UZWlwfD7gomBHNB7zQRSGtCYxydadBJsbYlNiI8C2t
        EnNsoNxBpZRoWuYzGG16yEHDF+HiY1UsFXwet/uMwkUvdsGVuRnvQjkG5P4hSFHK
        8i7XjtWwizhD/OHWqot5R+UumzNYPK+DsDfUI1qpUzfKxblLuSZvJO6wHcI/k+NG
        55lddWHHFoYfBDVIn6iqN110r8w3vEKeeLWv/5virITg/5iFIxfvuXyPpOQSFz6E
        rwSz547blvqMljHkCp9NnumdIbkBDQRgBT3RAQgA4fFLaZ1HsK+K0fdLxdzRUB2S
        8FfIuV1n53taP6OYzk5fPRf/vwXt7E0IUONvBd/z7LfkR/eGbdG3i+cQnN8fJjHZ
        1DkziTK4Xjq7vgLIOGzONFQwWj5XKoTBpw2+cfEmqiBlFY5erVzgxrZXB0aZeY3w
        vWW2haOBuTUynPcVsdoDCsO5SYgFX8tDmZRUIwsLYvS5gI9DLxO6mLQnXqZapWD6
        GeVw+eCL/EST3eimrsRGPaBWUTplHaVDT3hV+w7Yx5SfjDJxWUJAwl13+YGB6HvR
        T5gJuSgJ5MUQDtBMVGUDsv4Br0YiBSytquAgAAcJ4gzCzqNal623c/soXio+xQAR
        AQABiQEfBBgBCgAJAhsMBQJiIGsSAAoJECoB+irrPaxAAWkH/RzJ3ZvJYb2BSeii
        sKza+SXUIJl2LPjUJ6q8dfI3ity0jEpWpKFxN4tYcp3B9LZAon3g0P/Gc5kftIb7
        7qAnlCkh+dt8RtCeWEvdnZlIiS/k5w3dogBHzr2L980QOdyFZAxv6bugzEPzh3Dm
        rBbH9JzSx0c+weeLZdgtDdgIXiPgtrQfdPe4uxjx39zy/k4Lt6M1mKsuy872yn35
        EMUeQhb82If+4fQOcYOfjc2I3MBMTd8cz/s6ZKKR1QD7rms2JPx1KJfIxjCSRyOL
        dFmDih7j+JmBz7IYFRWMqp8SR0MBkVIykZYomEChhKOD5vSXOVEq/CD0tN63dlhs
        fnRBNE0=
        =rDM7
        -----END PGP PUBLIC KEY BLOCK-----
    destination:
      local:
        path: "/srv/repo/centos/stream/9/hyperscale"

Package

Root      : /
Conf File : /etc/pacman.conf
DB Path   : /var/lib/pacman/
Cache Dirs: /var/cache/pacman/pkg/  
Hook Dirs : /usr/share/libalpm/hooks/  /etc/pacman.d/hooks/  
Lock File : /var/lib/pacman/db.lck
Log File  : /var/log/pacman.log
GPG Dir   : /etc/pacman.d/gnupg/
Targets   : reposync-zextras
Name            : reposync-zextras
Version         : 0.9.1-1
Description     : Mirrors Debian and RedHat repositories to an AWS S3 bucket (with Cloudfront support) or a local directory
Architecture    : x86_64
URL             : https://github.com/Zextras/reposync
Licenses        : AGPL3
Groups          : None
Provides        : None
Depends On      : None
Optional Deps   : None
Required By     : None
Optional For    : None
Conflicts With  : None
Replaces        : None
Installed Size  : 7.64 MiB
Packager        : Unknown Packager
Build Date      : Wed Oct  2 22:03:58 2024
Install Date    : Wed Oct  2 22:05:56 2024
Install Reason  : Explicitly installed
Install Script  : No
Validated By    : None

checksum data

<?xml version="1.0" encoding="UTF-8"?>
<metadata xmlns="http://linux.duke.edu/metadata/common" xmlns:rpm="http://linux.duke.edu/metadata/rpm" packages="826">
<package type="rpm">
  <name>amd-gpu-firmware</name>
  <arch>noarch</arch>
  <version epoch="0" ver="20230919" rel="4.hs.el9"/>
  <checksum type="sha256" pkgid="YES">6b9518930889a17339c60c5336f1dcefa6365576e3ed855ebbc04eb8cc2d0697</checksum>
  <summary>Firmware for AMD GPUs</summary>
  <description>Firmware for AMD amdgpu and radeon GPUs.</description>
  <packager>CBS &lt;cbs@centos.org&gt;</packager>
  <url>http://www.kernel.org/</url>
  <time file="1697646702" build="1697646048"/>
  <size package="19779075" installed="26275117" archive="26401820"/>
  <location href="Packages/a/amd-gpu-firmware-20230919-4.hs.el9.noarch.rpm"/>
  <format>
    <rpm:license>Redistributable, no modification permitted</rpm:license>
    <rpm:vendor>CentOS Hyperscale SIG</rpm:vendor>
    <rpm:group>Unspecified</rpm:group>
    <rpm:buildhost>x86-07.rdu2.centos.org</rpm:buildhost>
    <rpm:sourcerpm>linux-firmware-20230919-4.hs.el9.src.rpm</rpm:sourcerpm>
    <rpm:header-range start="4504" end="129249"/>
    <rpm:provides>
      <rpm:entry name="amd-gpu-firmware" flags="EQ" epoch="0" ver="20230919" rel="4.hs.el9"/>
    </rpm:provides>
    <rpm:requires>
      <rpm:entry name="linux-firmware-whence"/>
    </rpm:requires>
  </format>

With the command

curl https://mirror.stream.centos.org/SIGs/9-stream/hyperscale/x86_64/packages-main/Packages/a/amd-gpu-firmware-20230919-4.hs.el9.noarch.rpm | sha256sum

yielding

6b9518930889a17339c60c5336f1dcefa6365576e3ed855ebbc04eb8cc2d0697  -
WaywardWizard commented 5 days ago

Possibly this project does not support repositories that have packages arranged in folders of the alphabet letters?