zcash / zcash-gitian

Deterministic build environment for Zcash
https://z.cash/blog/deterministic-builds.html
18 stars 29 forks source link

gitian build fails reproducibly on bullseye during apt-get stage #145

Closed softminus closed 2 years ago

softminus commented 2 years ago
Compiling variant: version-5.2.0_bullseye                                                                                                                                                          [47/1622]

From https://github.com/zcash/zcash                 
 * branch                version-5.2.0 -> FETCH_HEAD
--- Building for bullseye amd64 ---                                                                   
Stopping target if it is up                                                                                                                    
Making a new image copy                                                
sudo: unable to resolve host gitian: Name or service not known                                        
Reading package lists... Done                                                                                                                  
Building dependency tree... Done                                       
The following packages will be REMOVED:                                                               
  rsyslog*                                                             
0 upgraded, 0 newly installed, 1 to remove and 0 not upgraded.
After this operation, 1920 kB disk space will be freed.                                                                                        
(Reading database ... 18326 files and directories currently installed.)                                                                                                                                     
Removing rsyslog (8.2102.0-2+deb11u1) ...        
invoke-rc.d: could not determine current runlevel   
Stopping enhanced syslogd: rsyslogd already stopped.                                                                                           
(Reading database ... 18268 files and directories currently installed.)                                                                                                                                     
Purging configuration files for rsyslog (8.2102.0-2+deb11u1) ...  
Adding 'local diversion of /sbin/initctl to /sbin/initctl.distrib'                                                                             
Adding 'local diversion of /usr/bin/ischroot to /usr/bin/ischroot.distrib'                                                  
dpkg-divert: warning: diverting file '/usr/bin/ischroot' from an Essential package with rename is dangerous, use --no-rename
Adding 'local diversion of /usr/sbin/policy-rc.d to /usr/sbin/policy-rc.d.distrib'                                                                                                                          
Starting target         
Checking if target is up   
Preparing build environment                                            
Updating apt-get repository (log in var/install.log)   
Installing additional packages (log in var/install.log)                                               
Traceback (most recent call last):                                     
        6: from ./bin/gbuild:347:in `<main>'
        5: from ./bin/gbuild:347:in `each'           
        4: from ./bin/gbuild:349:in `block in <main>'
        3: from ./bin/gbuild:349:in `each'                      
        2: from ./bin/gbuild:354:in `block (2 levels) in <main>'
        1: from ./bin/gbuild:120:in `build_one_configuration'                                                                                                                     
./bin/gbuild:23:in `system!': failed to run on-target -u root -e DEBIAN_FRONTEND=noninteractive apt-get --no-install-recommends -y install curl autoconf automake bsdmainutils binutils-gold ca-certificates
 faketime g++-multilib git-core libc6-dev libtinfo5 libtool libxml2 m4 ncurses-dev pkg-config python unzip wget zlib1g-dev >> var/install.log 2>&1 (RuntimeError)
File '/home/vagrant/gitian.sigs/version-5.2.0_bullseye/sasha/zcash-5.2.0-rc1-build.assert.sig' exists. Overwrite? (y/N) 
gpg: signal Interrupt caught ... exiting
Traceback (most recent call last):
        2: from ./bin/gsign:93:in `<main>'
        1: from ./bin/gsign:11:in `system!'
./bin/gsign:11:in `system': Interrupt
vagrant@zcash-build:~$ ^C              

Here's install.log:

Hit:1 http://10.0.2.15:3142/ftp.debian.org/debian bullseye InRelease
Get:2 http://10.0.2.15:3142/security.debian.org/debian-security bullseye-security InRelease [48.4 kB]
Get:3 http://10.0.2.15:3142/ftp.debian.org/debian bullseye-updates InRelease [44.1 kB]
Get:4 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main Translation-en [6243 kB]
Get:5 http://10.0.2.15:3142/security.debian.org/debian-security bullseye-security/main amd64 Packages [167 kB]
Get:6 http://10.0.2.15:3142/security.debian.org/debian-security bullseye-security/main Translation-en [105 kB]
Get:7 http://10.0.2.15:3142/ftp.debian.org/debian bullseye-updates/main amd64 Packages [2592 B]
Get:8 http://10.0.2.15:3142/ftp.debian.org/debian bullseye-updates/main Translation-en [2343 B]
Fetched 6612 kB in 2s (3029 kB/s)
Reading package lists...
Reading package lists...
Building dependency tree...
Reading state information...
binutils is already the newest version (2.35.2-2).
git is already the newest version (1:2.30.2-1).
libc6-dev is already the newest version (2.31-13+deb11u3).
wget is already the newest version (1.21-1+deb11u1).
The following additional packages will be installed:
  autotools-dev bsdextrautils file g++-10-multilib gcc-10-multilib
  gcc-multilib lib32asan6 lib32atomic1 lib32gcc-10-dev lib32gcc-s1 lib32gomp1
  lib32itm1 lib32quadmath0 lib32stdc++-10-dev lib32stdc++6 lib32ubsan1
  libc6-dev-i386 libc6-dev-x32 libc6-i386 libc6-x32 libcurl4 libfaketime
  libglib2.0-0 libicu67 libmagic-mgc libmagic1 libpython2-stdlib
  libpython2.7-minimal libpython2.7-stdlib libsigsegv2 libx32asan6
  libx32atomic1 libx32gcc-10-dev libx32gcc-s1 libx32gomp1 libx32itm1
  libx32quadmath0 libx32stdc++-10-dev libx32stdc++6 libx32ubsan1 mailcap
  mime-support ncal openssl python2 python2-minimal python2.7
  python2.7-minimal
Suggested packages:
  autoconf-archive gnu-standards autoconf-doc gettext calendar whois vacation
  mailutils lib32stdc++6-10-dbg libx32stdc++6-10-dbg ncurses-doc libtool-doc
  gfortran | fortran95-compiler gcj-jdk m4-doc python2-doc python-tk
  python2.7-doc binfmt-support zip
Recommended packages:
  libglib2.0-data shared-mime-info xdg-user-dirs libltdl-dev
The following NEW packages will be installed:
  autoconf automake autotools-dev bsdextrautils bsdmainutils ca-certificates
  curl faketime file g++-10-multilib g++-multilib gcc-10-multilib gcc-multilib
  lib32asan6 lib32atomic1 lib32gcc-10-dev lib32gcc-s1 lib32gomp1 lib32itm1
  lib32quadmath0 lib32stdc++-10-dev lib32stdc++6 lib32ubsan1 libc6-dev-i386
  libc6-dev-x32 libc6-i386 libc6-x32 libcurl4 libfaketime libglib2.0-0
  libicu67 libmagic-mgc libmagic1 libncurses-dev libpython2-stdlib
  libpython2.7-minimal libpython2.7-stdlib libsigsegv2 libtinfo5 libtool
  libx32asan6 libx32atomic1 libx32gcc-10-dev libx32gcc-s1 libx32gomp1
  libx32itm1 libx32quadmath0 libx32stdc++-10-dev libx32stdc++6 libx32ubsan1
  libxml2 m4 mailcap mime-support ncal openssl pkg-config python-is-python2
  python2 python2-minimal python2.7 python2.7-minimal unzip zlib1g-dev
0 upgraded, 64 newly installed, 0 to remove and 0 not upgraded.
Need to get 41.8 MB of archives.
After this operation, 181 MB of additional disk space will be used.
Get:1 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 bsdextrautils amd64 2.36.1-8+deb11u1 [145 kB]
Get:2 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libpython2.7-minimal amd64 2.7.18-8 [396 kB]
Get:3 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 python2.7-minimal amd64 2.7.18-8 [1322 kB]
Get:4 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 python2-minimal amd64 2.7.18-3 [34.2 kB]
Get:5 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 mailcap all 3.69 [31.7 kB]
Get:6 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 mime-support all 3.66 [10.9 kB]
Get:7 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libpython2.7-stdlib amd64 2.7.18-8 [1865 kB]
Get:8 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 python2.7 amd64 2.7.18-8 [311 kB]
Get:9 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libpython2-stdlib amd64 2.7.18-3 [21.2 kB]
Get:10 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 python2 amd64 2.7.18-3 [24.5 kB]
Get:11 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 openssl amd64 1.1.1n-0+deb11u3 [853 kB]
Get:12 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 ca-certificates all 20210119 [158 kB]
Get:13 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libmagic-mgc amd64 1:5.39-3 [273 kB]
Get:14 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libmagic1 amd64 1:5.39-3 [126 kB]
Get:15 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 file amd64 1:5.39-3 [69.1 kB]
Get:16 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libsigsegv2 amd64 2.13-1 [34.8 kB]
Get:17 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 m4 amd64 1.4.18-5 [204 kB]
Get:18 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 autoconf all 2.69-14 [313 kB]
Get:19 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 autotools-dev all 20180224.1+nmu1 [77.1 kB]
Get:20 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 automake all 1:1.16.3-2 [814 kB]
Get:21 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 ncal amd64 12.1.7+nmu3 [30.1 kB]
Get:22 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 bsdmainutils all 12.1.7+nmu3 [16.4 kB]
Get:23 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libcurl4 amd64 7.74.0-1.3+deb11u1 [341 kB]
Get:24 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 curl amd64 7.74.0-1.3+deb11u1 [267 kB]
Get:25 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libfaketime amd64 0.9.8-9 [40.1 kB]
Get:26 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 faketime amd64 0.9.8-9 [15.9 kB]
Get:27 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libc6-i386 amd64 2.31-13+deb11u3 [2619 kB]
Get:28 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libc6-dev-i386 amd64 2.31-13+deb11u3 [1840 kB]
Get:29 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libc6-x32 amd64 2.31-13+deb11u3 [2668 kB]
Get:30 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libc6-dev-x32 amd64 2.31-13+deb11u3 [1934 kB]
Get:31 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 lib32gcc-s1 amd64 10.2.1-6 [49.4 kB]
Get:32 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libx32gcc-s1 amd64 10.2.1-6 [41.3 kB]
Get:33 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 lib32gomp1 amd64 10.2.1-6 [107 kB]
Get:34 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libx32gomp1 amd64 10.2.1-6 [102 kB]
Get:35 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 lib32itm1 amd64 10.2.1-6 [27.9 kB]
Get:36 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libx32itm1 amd64 10.2.1-6 [26.1 kB]
Get:37 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 lib32atomic1 amd64 10.2.1-6 [8508 B]
Get:38 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libx32atomic1 amd64 10.2.1-6 [8968 B]
Get:39 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 lib32asan6 amd64 10.2.1-6 [1923 kB]
Get:40 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libx32asan6 amd64 10.2.1-6 [1906 kB]
Get:41 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 lib32stdc++6 amd64 10.2.1-6 [510 kB]
Get:42 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 lib32ubsan1 amd64 10.2.1-6 [750 kB]
Err:43 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libx32stdc++6 amd64 10.2.1-6
  502  Connection closed [IP: 10.0.2.15 3142]
Err:44 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libx32ubsan1 amd64 10.2.1-6
  502  Connection closed [IP: 10.0.2.15 3142]
Err:45 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 lib32quadmath0 amd64 10.2.1-6
  502  Connection closed [IP: 10.0.2.15 3142]
Err:46 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libx32quadmath0 amd64 10.2.1-6
  502  Connection closed [IP: 10.0.2.15 3142]
Err:47 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 lib32gcc-10-dev amd64 10.2.1-6
  502  Connection closed [IP: 10.0.2.15 3142]
Err:48 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libx32gcc-10-dev amd64 10.2.1-6
  502  Connection closed [IP: 10.0.2.15 3142]
Err:49 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 gcc-10-multilib amd64 10.2.1-6
  502  Connection closed [IP: 10.0.2.15 3142]
Err:50 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 lib32stdc++-10-dev amd64 10.2.1-6
  502  Connection closed [IP: 10.0.2.15 3142]
Err:51 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libx32stdc++-10-dev amd64 10.2.1-6
  502  Connection closed [IP: 10.0.2.15 3142]
Err:52 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 g++-10-multilib amd64 10.2.1-6
  502  Connection closed [IP: 10.0.2.15 3142]
Err:53 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 gcc-multilib amd64 4:10.2.1-1
  502  Connection closed [IP: 10.0.2.15 3142]
Err:54 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 g++-multilib amd64 4:10.2.1-1
  502  Connection closed [IP: 10.0.2.15 3142]
Err:55 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libglib2.0-0 amd64 2.66.8-1
  502  Connection closed [IP: 10.0.2.15 3142]
Err:56 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libicu67 amd64 67.1-7
  502  Connection closed [IP: 10.0.2.15 3142]
Err:57 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libncurses-dev amd64 6.2+20201114-2
  502  Connection closed [IP: 10.0.2.15 3142]
Err:58 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libtinfo5 amd64 6.2+20201114-2
  502  Connection closed [IP: 10.0.2.15 3142]
Err:59 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libtool all 2.4.6-15
  502  Connection closed [IP: 10.0.2.15 3142]
Ign:60 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libxml2 amd64 2.9.10+dfsg-6.7+deb11u2
Err:61 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 pkg-config amd64 0.29.2-1
  502  Connection closed [IP: 10.0.2.15 3142]
Err:62 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 python-is-python2 all 2.7.18-9
  502  Connection closed [IP: 10.0.2.15 3142]
Err:63 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 unzip amd64 6.0-26
  502  Connection closed [IP: 10.0.2.15 3142]
Ign:64 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-2+deb11u1
Get:60 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libxml2 amd64 2.9.10+dfsg-6.7+deb11u2 [692 kB]
Get:64 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-2+deb11u1 [191 kB]
Fetched 23.2 MB in 1s (19.9 MB/s)
E: Failed to fetch http://10.0.2.15:3142/ftp.debian.org/debian/pool/main/g/gcc-10/libx32stdc%2b%2b6_10.2.1-6_amd64.deb  502  Connection closed [IP: 10.0.2.15 3142]
E: Failed to fetch http://10.0.2.15:3142/ftp.debian.org/debian/pool/main/g/gcc-10/libx32ubsan1_10.2.1-6_amd64.deb  502  Connection closed [IP: 10.0.2.15 3142]
E: Failed to fetch http://10.0.2.15:3142/ftp.debian.org/debian/pool/main/g/gcc-10/lib32quadmath0_10.2.1-6_amd64.deb  502  Connection closed [IP: 10.0.2.15 3142]
E: Failed to fetch http://10.0.2.15:3142/ftp.debian.org/debian/pool/main/g/gcc-10/libx32quadmath0_10.2.1-6_amd64.deb  502  Connection closed [IP: 10.0.2.15 3142]
E: Failed to fetch http://10.0.2.15:3142/ftp.debian.org/debian/pool/main/g/gcc-10/lib32gcc-10-dev_10.2.1-6_amd64.deb  502  Connection closed [IP: 10.0.2.15 3142]
E: Failed to fetch http://10.0.2.15:3142/ftp.debian.org/debian/pool/main/g/gcc-10/libx32gcc-10-dev_10.2.1-6_amd64.deb  502  Connection closed [IP: 10.0.2.15 3142]
E: Failed to fetch http://10.0.2.15:3142/ftp.debian.org/debian/pool/main/g/gcc-10/gcc-10-multilib_10.2.1-6_amd64.deb  502  Connection closed [IP: 10.0.2.15 3142]
E: Failed to fetch http://10.0.2.15:3142/ftp.debian.org/debian/pool/main/g/gcc-10/lib32stdc%2b%2b-10-dev_10.2.1-6_amd64.deb  502  Connection closed [IP: 10.0.2.15 3142]
E: Failed to fetch http://10.0.2.15:3142/ftp.debian.org/debian/pool/main/g/gcc-10/libx32stdc%2b%2b-10-dev_10.2.1-6_amd64.deb  502  Connection closed [IP: 10.0.2.15 3142]
E: Failed to fetch http://10.0.2.15:3142/ftp.debian.org/debian/pool/main/g/gcc-10/g%2b%2b-10-multilib_10.2.1-6_amd64.deb  502  Connection closed [IP: 10.0.2.15 3142]
E: Failed to fetch http://10.0.2.15:3142/ftp.debian.org/debian/pool/main/g/gcc-defaults/gcc-multilib_10.2.1-1_amd64.deb  502  Connection closed [IP: 10.0.2.15 3142]
E: Failed to fetch http://10.0.2.15:3142/ftp.debian.org/debian/pool/main/g/gcc-defaults/g%2b%2b-multilib_10.2.1-1_amd64.deb  502  Connection closed [IP: 10.0.2.15 3142]
E: Failed to fetch http://10.0.2.15:3142/ftp.debian.org/debian/pool/main/g/glib2.0/libglib2.0-0_2.66.8-1_amd64.deb  502  Connection closed [IP: 10.0.2.15 3142]
E: Failed to fetch http://10.0.2.15:3142/ftp.debian.org/debian/pool/main/i/icu/libicu67_67.1-7_amd64.deb  502  Connection closed [IP: 10.0.2.15 3142]
E: Failed to fetch http://10.0.2.15:3142/ftp.debian.org/debian/pool/main/n/ncurses/libncurses-dev_6.2%2b20201114-2_amd64.deb  502  Connection closed [IP: 10.0.2.15 3142]
E: Failed to fetch http://10.0.2.15:3142/ftp.debian.org/debian/pool/main/n/ncurses/libtinfo5_6.2%2b20201114-2_amd64.deb  502  Connection closed [IP: 10.0.2.15 3142]
E: Failed to fetch http://10.0.2.15:3142/ftp.debian.org/debian/pool/main/libt/libtool/libtool_2.4.6-15_all.deb  502  Connection closed [IP: 10.0.2.15 3142]
E: Failed to fetch http://10.0.2.15:3142/ftp.debian.org/debian/pool/main/p/pkg-config/pkg-config_0.29.2-1_amd64.deb  502  Connection closed [IP: 10.0.2.15 3142]
E: Failed to fetch http://10.0.2.15:3142/ftp.debian.org/debian/pool/main/w/what-is-python/python-is-python2_2.7.18-9_all.deb  502  Connection closed [IP: 10.0.2.15 3142]
E: Failed to fetch http://10.0.2.15:3142/ftp.debian.org/debian/pool/main/u/unzip/unzip_6.0-26_amd64.deb  502  Connection closed [IP: 10.0.2.15 3142]
E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?

Interestingly enough, it seems to work until about ~40 packages have been fetched:

Get:39 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 lib32asan6 amd64 10.2.1-6 [1923 kB]
Get:40 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libx32asan6 amd64 10.2.1-6 [1906 kB]
Get:41 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 lib32stdc++6 amd64 10.2.1-6 [510 kB]
Get:42 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 lib32ubsan1 amd64 10.2.1-6 [750 kB]
Err:43 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libx32stdc++6 amd64 10.2.1-6
  502  Connection closed [IP: 10.0.2.15 3142]
Err:44 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libx32ubsan1 amd64 10.2.1-6
  502  Connection closed [IP: 10.0.2.15 3142]
Err:45 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 lib32quadmath0 amd64 10.2.1-6
  502  Connection closed [IP: 10.0.2.15 3142]
Err:46 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libx32quadmath0 amd64 10.2.1-6
  502  Connection closed [IP: 10.0.2.15 3142]

and the point of failure is not quite deterministic, on another machine:

Get:42 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 lib32ubsan1 amd64 10.2.1-6 [750 kB]
Get:43 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libx32stdc++6 amd64 10.2.1-6 [478 kB]
Get:44 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libx32ubsan1 amd64 10.2.1-6 [757 kB]
Get:45 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 lib32quadmath0 amd64 10.2.1-6 [229 kB]
Get:46 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libx32quadmath0 amd64 10.2.1-6 [148 kB]
Get:47 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 lib32gcc-10-dev amd64 10.2.1-6 [2181 kB]
Err:48 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libx32gcc-10-dev amd64 10.2.1-6
  502  Connection closed [IP: 10.0.2.15 3142]
Err:49 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 gcc-10-multilib amd64 10.2.1-6
  502  Connection closed [IP: 10.0.2.15 3142]
Err:50 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 lib32stdc++-10-dev amd64 10.2.1-6
  502  Connection closed [IP: 10.0.2.15 3142]
Err:51 http://10.0.2.15:3142/ftp.debian.org/debian bullseye/main amd64 libx32stdc++-10-dev amd64 10.2.1-6
  502  Connection closed [IP: 10.0.2.15 3142]
softminus commented 2 years ago

Port 3142 is used by apt-cacher-ng https://wiki.debian.org/AptCacherNg, so my running guess is that something goes wrong with one of: 1) apt-cacher-ng itself 2) the VM/container it's running on 3) the networking setup between the host the apt-get is running on and the apt-cacher-ng host (if those are different)

softminus commented 2 years ago

hm running it a few times (with the bullseye-only patch, adding suites="bullseye" after the suites=$(explode_yaml_file.py line to gitian-build.sh) seems to build up some sort of debian package cache enough for the apt-get to proceed; i don't have a completed build yet with this but if we can't diagnose the problem it might be a useful workaround

softminus commented 2 years ago

It worked OK without any changes, my guess is some sort of issue with the deb mirrors that [was] resolved

softminus commented 2 years ago

Created a new issue #147 for this problem