search

wolfi-dev / os

Main package repository for production Wolfi images
Other
828 stars 256 forks source link

Invalid fetch #30234

Open xnox opened 1 month ago

xnox commented 1 month ago

By clobbing together apkrane json output, doing curl --head request to get content size and comparing the results on per apk package and finding those that are different.

then mapping back to Origin to get list of yaml files, and checking those that exists, there are 433 yaml files which have at least one apk on x86_64 that is failing to apk fetch with bad archive.

Can these please be no change bumped and rebuilt?

exists.txt

ZiTAL commented 3 weeks ago 
apk fetch -R git rsync unzip wget zip
Downloading bash-5.2.37-r2
Downloading ca-certificates-bundle-20241010-r1
Downloading cyrus-sasl-2.1.28-r4
Downloading gdbm-1.24-r0
Downloading git-2.47.0-r0
Downloading glibc-2.40-r3
Downloading glibc-locale-posix-2.40-r3
Downloading heimdal-7.8.0-r6
Downloading keyutils-libs-1.6.3-r4
Downloading krb5-conf-1.0-r3
Downloading krb5-libs-1.21.3-r1
Downloading ld-linux-2.40-r3
Downloading libacl1-2.3.2-r3
Downloading libattr1-2.5.2-r3
Downloading libbrotlicommon1-1.1.0-r4
Downloading libbrotlidec1-1.1.0-r4
Downloading libcom_err-1.47.1-r0
ERROR: libcom_err-1.47.1-r0: BAD archive
Downloading libcrypt1-2.40-r3
Downloading libcrypto3-3.3.2-r2
Downloading libcurl-openssl4-8.10.1-r2
Downloading libevent-2.1.12-r6
Downloading libexpat1-2.6.3-r1
Downloading libgcc-14.2.0-r4
Downloading libidn2-2.3.7-r2
ERROR: libidn2-2.3.7-r2: BAD archive
Downloading libldap-2.6.8-r5
Downloading liblz4-1-1.10.0-r2
Downloading libnghttp2-14-1.64.0-r0
Downloading libpcre2-8-0-10.44-r1
ERROR: libpcre2-8-0-10.44-r1: BAD archive
Downloading libpsl-0.21.5-r3
ERROR: libpsl-0.21.5-r3: BAD archive
Downloading libssl3-3.3.2-r2
Downloading libunistring-1.3-r1
Downloading libverto-0.3.2-r4
ERROR: libverto-0.3.2-r4: BAD archive
Downloading libxcrypt-4.4.36-r8
Downloading libzstd1-1.5.6-r5
Downloading ncurses-6.5_p20241006-r3
Downloading ncurses-terminfo-base-6.5_p20241006-r3
Downloading popt-1.19-r1
Downloading readline-8.2.13-r1
Downloading rsync-3.3.0-r1
Downloading sqlite-libs-3.46.1-r0
Downloading unzip-6.0-r1
Downloading wget-1.24.5-r4
Downloading wolfi-baselayout-20230201-r15
Downloading xxhash-libs-0.8.2-r1
Downloading zip-3.0-r6
Downloading zlib-1.3.1-r4

but no problems installing directly

xnox commented 3 weeks ago

i am dreaming that many packages will just naturally get rebuild, but it is still more than 245 bad ones.

I guess i should bite it and make PRs to automatically update them.

xnox commented 3 weeks ago

@ZiTAL btw does fetching from https://apk.cgr.dev/chainguard mirror work without any errors? that is not browsable but it is backed by a better CDN which should not have any such errors.

ZiTAL commented 3 weeks ago

@xnox 

apk fetch -R git rsync unzip wget zip --allow-untrusted
Downloading bash-5.2.37-r2
Downloading ca-certificates-bundle-20241010-r1
Downloading cyrus-sasl-2.1.28-r4
Downloading gdbm-1.24-r0
Downloading git-2.47.0-r0
Downloading glibc-2.40-r3
Downloading glibc-locale-posix-2.40-r3
Downloading heimdal-7.8.0-r6
Downloading keyutils-libs-1.6.3-r4
Downloading krb5-conf-1.0-r3
Downloading krb5-libs-1.21.3-r1
Downloading ld-linux-2.40-r3
Downloading libacl1-2.3.2-r3
Downloading libattr1-2.5.2-r3
Downloading libbrotlicommon1-1.1.0-r4
Downloading libbrotlidec1-1.1.0-r4
Downloading libcom_err-1.47.1-r0
Downloading libcrypt1-2.40-r3
Downloading libcrypto3-3.4.0-r1
Downloading libcurl-openssl4-8.10.1-r2
Downloading libevent-2.1.12-r6
Downloading libexpat1-2.6.3-r1
Downloading libgcc-14.2.0-r4
Downloading libidn2-2.3.7-r2
Downloading libldap-2.6.8-r5
Downloading liblz4-1-1.10.0-r2
Downloading libnghttp2-14-1.64.0-r0
Downloading libpcre2-8-0-10.44-r1
Downloading libpsl-0.21.5-r3
Downloading libssl3-3.4.0-r1
Downloading libunistring-1.3-r1
Downloading libverto-0.3.2-r4
Downloading libxcrypt-4.4.36-r8
Downloading libzstd1-1.5.6-r5
Downloading ncurses-6.5_p20241006-r3
Downloading ncurses-terminfo-base-6.5_p20241006-r3
Downloading popt-1.19-r1
Downloading readline-8.2.13-r1
Downloading rsync-3.3.0-r1
Downloading sqlite-libs-3.46.1-r0
Downloading unzip-6.0-r1
Downloading wget-1.24.5-r4
Downloading wolfi-baselayout-20230201-r15
Downloading xxhash-libs-0.8.2-r1
Downloading zip-3.0-r6
Downloading zlib-1.3.1-r4

works ok