search

esl / packages

Makefile- and Docker-based build system for ESL's erlang and elixir binary packages.
Apache License 2.0
9 stars 6 forks source link

Size mismatch in debian repos #64

Closed rsommer closed 1 year ago

rsommer commented 1 year ago

While mirroring erlang releases from https://packages.erlang-solutions.com we are encountering size mismatch errors at least in stretch and buster repos:

buster: https://packages.erlang-solutions.com/debian/pool/esl-erlang_25.2.3-1~debian~buster_amd64.deb: size check mismatch 40679732 != 40676556 stretch: https://packages.erlang-solutions.com/debian/pool/esl-erlang_25.2.3-1~debian~stretch_amd64.deb: size check mismatch 40343740 != 40345880

Example for debian stretch

Excerpt from Packages-file:

Filename: pool/esl-erlang_25.2.3-1~debian~stretch_amd64.deb
Size: 40345880
MD5sum: 6f3b174928d4ce718e2290a092e34a72

Actual downloaded size: 

$ ls -l esl-erlang_25.2.3-1~debian~stretch_amd64.deb 
-rw-rw-r-- 1 nobody nogroup 40343740 Feb 24 10:32 esl-erlang_25.2.3-1~debian~stretch_amd64.deb

Actual MD5:

$ md5sum esl-erlang_25.2.3-1~debian~stretch_amd64.deb 
0bf3973aa825b45133e7054d735918d6  esl-erlang_25.2.3-1~debian~stretch_amd64.deb

Example for debian buster

Excerpt from Packages-file:

Filename: pool/esl-erlang_25.2.3-1~debian~buster_amd64.deb
Size: 40676556
MD5sum: 6b2bebd35eb5e1f9f2b745432546570e

Actual downloaded size:

$ ls -l esl-erlang_25.2.3-1~debian~buster_amd64.deb
-rw-rw-r-- 1 nobody nogroup 40679732 Feb 24 10:32 esl-erlang_25.2.3-1~debian~buster_amd64.deb

Actual MD5:

$ md5sum esl-erlang_25.2.3-1~debian~buster_amd64.deb
385d92896ab439765adcac0756a613cf  esl-erlang_25.2.3-1~debian~buster_amd64.deb
tobiastom commented 1 year ago

I'm getting a similar error:

E: Failed to fetch http://binaries.erlang-solutions.com/debian/pool/esl-erlang_25.2.3-2~ubuntu~focal_amd64.deb  File has unexpected size (40825344 != 40821704). Mirror sync in progress? [IP: 108.138.167.128 80]
   Hashes of expected file:
    - SHA256:bd4d43ba5d129873babb9a2c325c10c0b3831046998f10e81d63b0feefda735d
    - SHA1:38e4f653a0ef0daf0ddad82c84b8973b01b6bf80 [weak]
    - MD5Sum:79db75baab92dfffa5ad84f2a2f7abb4 [weak]
    - Filesize:40821704 [weak]

Not sure of this might be related to https://github.com/esl/packages/issues/63#issuecomment-1443673858.

dalbarado commented 1 year ago

The issue should be solved, there is a corrupt package which is causing the issue.

rsommer commented 1 year ago

Still seeing the same error. Started sync right now: stretch:

Giving up on https://packages.erlang-solutions.com/debian/pool/esl-erlang_25.2.3-1~debian~stretch_amd64.deb...
ERROR: unable to update: download errors:
  https://packages.erlang-solutions.com/debian/pool/esl-erlang_25.2.3-1~debian~stretch_amd64.deb: size check mismatch 40343740 != 40345880

buster:

Giving up on https://packages.erlang-solutions.com/debian/pool/esl-erlang_25.2.3-1~debian~buster_amd64.deb...
ERROR: unable to update: download errors:
  https://packages.erlang-solutions.com/debian/pool/esl-erlang_25.2.3-1~debian~buster_amd64.deb: size check mismatch 40679732 != 40676556
tobiastom commented 1 year ago

Problem seems to be solved for me. Thank you.

rsommer commented 1 year ago

The Packages-file contains references to the same file(s) with different metadata:

buster:

$ wget https://packages.erlang-solutions.com/debian/dists/buster/contrib/binary-amd64/Packages.bz2

$ bzgrep -A 2 "esl-erlang_25.2.3-1~debian~buster_amd64.deb" Packages.bz2
Filename: pool/esl-erlang_25.2.3-1~debian~buster_amd64.deb
Size: 40676556
MD5sum: 6b2bebd35eb5e1f9f2b745432546570e
--
Filename: pool/esl-erlang_25.2.3-1~debian~buster_amd64.deb
Size: 40676556
MD5sum: 6c8402da931da516e1a619e34a015337
--
Filename: pool/esl-erlang_25.2.3-1~debian~buster_amd64.deb
Size: 40676556
MD5sum: a93ba470eab19801bd25488381a0eaa4
--
Filename: pool/esl-erlang_25.2.3-1~debian~buster_amd64.deb
Size: 40679732
MD5sum: 7c8681ce35f2a1909d4b7bfd917ce8f6
--
Filename: pool/esl-erlang_25.2.3-1~debian~buster_amd64.deb
Size: 40679732
MD5sum: 385d92896ab439765adcac0756a613cf

stretch:

$ wget https://packages.erlang-solutions.com/debian/dists/stretch/contrib/binary-amd64/Packages.bz2

$ bzgrep -A 2 "esl-erlang_25.2.3-2~debian~stretch_amd64.deb" Packages.bz2
Filename: pool/esl-erlang_25.2.3-2~debian~stretch_amd64.deb
Size: 40345814
MD5sum: 0942ac8c8dde09c0f5040f51758da06e
--
Filename: pool/esl-erlang_25.2.3-2~debian~stretch_amd64.deb
Size: 40341912
MD5sum: 3dc7552f2cb690a9cd47fd46a772a24a

$ bzgrep -A 2 "esl-erlang_25.2.3-1~debian~stretch_amd64.deb" Packages.bz2
Filename: pool/esl-erlang_25.2.3-1~debian~stretch_amd64.deb
Size: 40345880
MD5sum: 6f3b174928d4ce718e2290a092e34a72
--
Filename: pool/esl-erlang_25.2.3-1~debian~stretch_amd64.deb
Size: 40345880
MD5sum: 5428786b796558128d254a414ec8d45b
--
Filename: pool/esl-erlang_25.2.3-1~debian~stretch_amd64.deb
Size: 40345880
MD5sum: be6b42ac51d4d5bb1c8bf0cbba36e560
--
Filename: pool/esl-erlang_25.2.3-1~debian~stretch_amd64.deb
Size: 40343740
MD5sum: cca86733342ca0a3235a8c853a69e200
--
Filename: pool/esl-erlang_25.2.3-1~debian~stretch_amd64.deb
Size: 40343740
MD5sum: 0bf3973aa825b45133e7054d735918d6
jbe-dw commented 1 year ago

We encounter the same issue here, this is not fixed, please reopen.

2023-03-12 01:47:10 - Running: aptly mirror update erlang-stretch
Downloading http://packages.erlang-solutions.com/debian/dists/stretch/contrib/binary-amd64/Packages.bz2...
[!] skipping package esl-erlang_1:25.2.3-1_amd64: duplicate in packages index
[!] skipping package esl-erlang_1:25.2.3-1_amd64: duplicate in packages index
[!] skipping package esl-erlang_1:25.2.3-1_amd64: duplicate in packages index
[!] skipping package esl-erlang_1:25.2.3-1_amd64: duplicate in packages index
[!] skipping package esl-erlang_1:25.2.3-2_amd64: duplicate in packages index
Building download queue...
Download queue: 1 items (38.48 MiB)
Downloading http://packages.erlang-solutions.com/debian/pool/esl-erlang_25.2.3-1~debian~stretch_amd64.deb...
ERROR: unable to update: download errors:
  http://packages.erlang-solutions.com/debian/pool/esl-erlang_25.2.3-1~debian~stretch_amd64.deb: size check mismatch 40343740 != 40345880

Same for buster and bullseye

rsommer commented 1 year ago

Seems to be fixed for stretch, persists for buster:

$ aptly mirror update buster-erlang
Downloading https://packages.erlang-solutions.com/debian/dists/buster/Release...
Success downloading https://packages.erlang-solutions.com/debian/dists/buster/Release
Downloading & parsing package files...
Downloading https://packages.erlang-solutions.com/debian/dists/buster/contrib/binary-amd64/Packages.bz2...
Success downloading https://packages.erlang-solutions.com/debian/dists/buster/contrib/binary-amd64/Packages.bz2
[!] skipping package esl-erlang_1:25.2.3-1_amd64: duplicate in packages index
[!] skipping package esl-erlang_1:25.2.3-1_amd64: duplicate in packages index
[!] skipping package esl-erlang_1:25.2.3-1_amd64: duplicate in packages index
[!] skipping package esl-erlang_1:25.2.3-1_amd64: duplicate in packages index
Building download queue...
Download queue: 1 items (38.79 MiB)
Downloading https://packages.erlang-solutions.com/debian/pool/esl-erlang_25.2.3-1~debian~buster_amd64.deb...
Error downloading https://packages.erlang-solutions.com/debian/pool/esl-erlang_25.2.3-1~debian~buster_amd64.deb: https://packages.erlang-solutions.com/debian/pool/esl-erlang_25.2.3-1~debian~buster_amd64.deb: size check mismatch 40679732 != 40676556 retrying...
Retrying 0 https://packages.erlang-solutions.com/debian/pool/esl-erlang_25.2.3-1~debian~buster_amd64.deb...
Giving up on https://packages.erlang-solutions.com/debian/pool/esl-erlang_25.2.3-1~debian~buster_amd64.deb...
ERROR: unable to update: download errors:
  https://packages.erlang-solutions.com/debian/pool/esl-erlang_25.2.3-1~debian~buster_amd64.deb: size check mismatch 40679732 != 40676556
rsommer commented 1 year ago

Seems to be fixed now, thank you!

:~$ aptly mirror update buster-erlang
Downloading https://packages.erlang-solutions.com/debian/dists/buster/Release...
Success downloading https://packages.erlang-solutions.com/debian/dists/buster/Release
Downloading & parsing package files...
Downloading https://packages.erlang-solutions.com/debian/dists/buster/contrib/binary-amd64/Packages.bz2...
Success downloading https://packages.erlang-solutions.com/debian/dists/buster/contrib/binary-amd64/Packages.bz2
Building download queue...
Download queue: 3 items (116.41 MiB)
Downloading https://packages.erlang-solutions.com/debian/pool/esl-erlang_25.2.3-3~debian~buster_amd64.deb...
Downloading https://packages.erlang-solutions.com/debian/pool/esl-erlang_25.2.3-1~debian~buster_amd64.deb...
Downloading https://packages.erlang-solutions.com/debian/pool/esl-erlang_25.3-1~debian~buster_amd64.deb...
Success downloading https://packages.erlang-solutions.com/debian/pool/esl-erlang_25.3-1~debian~buster_amd64.deb
Success downloading https://packages.erlang-solutions.com/debian/pool/esl-erlang_25.2.3-1~debian~buster_amd64.deb
Success downloading https://packages.erlang-solutions.com/debian/pool/esl-erlang_25.2.3-3~debian~buster_amd64.deb

Mirror `buster-erlang` has been successfully updated.
dalbarado commented 1 year ago

Great, sorry for the inconvenience. We re working for a new building package system, it would be online by the end of the month (March)The old one will be available until June after that will be replaced by the new one.

jbe-dw commented 1 year ago

I'm sorry but I'm still getting an error for bullseye:


ERROR: unable to update: download errors:
  http://packages.erlang-solutions.com/debian/pool/esl-erlang_25.2.3-1~debian~bullseye_amd64.deb: size check mismatch 40631804 != 40634644