easybuilders / easybuild-easyconfigs

A collection of easyconfig files that describe which software to build using which build options with EasyBuild.
https://easybuild.io
GNU General Public License v2.0
373 stars 699 forks source link

File format not recognized / checksum failed #19429

Open mfruhner opened 9 months ago

mfruhner commented 9 months ago

Hello, I am trying to build R 4.2 with the following command:

eb -r --prefix /cluster/user/$USER/.eb/ /usr/local/easybuild/easyconfigs/r/R/R-4.2.2-foss-2022b.eb

At some point it tries to install the dependency

/easybuild/easyconfigs/l/libvorbis/libvorbis-1.3.7-GCCcore-12.2.0.eb

but it fails with a failed checksum validation. When I ignore the checksum, I get the following error, which indicates that the source file was somehow changed:

  == Temporary log file in case of crash /tmp/eb-336qzpde/easybuild-esvigjv6.log
  == found valid index for /home/hpc-admin/.local/easybuild/easyconfigs, so using it...
  == found valid index for /home/hpc-admin/.local/easybuild/easyconfigs, so using it...
  == resolving dependencies ...
  == processing EasyBuild easyconfig /home/hpc-admin/.local/easybuild/easyconfigs/l/libvorbis/libvorbis-1.3.7-GCCcore-12.2.0.eb
  == building and installing libvorbis/1.3.7-GCCcore-12.2.0...
  == fetching files...
  == creating build dir, resetting environment...
  == unpacking...

  WARNING: Ignoring failing checksum verification for libvorbis-1.3.7.tar.xz

  == FAILED: Installation ended unsuccessfully (build directory: /cluster/user/hpc-admin/.eb/build/libvorbis/1.3.7/GCCcore-12.2.0): build failed (first 300 chars): cmd "unset TAPE; unxz /cluster/user/hpc-admin/.eb/sources/l/libvorbis/libvorbis-1.3.7.tar.xz --stdout | tar x" exited with exit code 2 and output:
  unxz: /cluster/user/hpc-admin/.eb/sources/l/libvorbis/libvorbis-1.3.7.tar.xz: File format not recognized
  tar: This does not look like a tar archive
  tar:  (took 0 secs)
  == Results of the build can be found in the log file(s) /tmp/eb-336qzpde/easybuild-libvorbis-1.3.7-20231214.142341.NdeOi.log
  ERROR: Build of /home/hpc-admin/.local/easybuild/easyconfigs/l/libvorbis/libvorbis-1.3.7-GCCcore-12.2.0.eb failed (err: 'build failed (first 300 chars): cmd "unset TAPE; unxz /cluster/user/hpc-admin/.eb/sources/l/libvorbis/libvorbis-1.3.7.tar.xz --stdout | tar x" exited with exit code 2 and output:\nunxz: /cluster/user/hpc-admin/.eb/sources/l/libvorbis/libvorbis-1.3.7.tar.xz: File format not recognized\ntar: This does not look like a tar archive\ntar: ')

Could we look into this? Thanks, Maik

Edit:

I am starting to see this issue in multiple .eb Files.. I now tried to build Octave 7.1 (no easyconfig for Octave 8 so far) and this time Szip failed to download with the same error:

ERROR: Build of /usr/local/easybuild/easyconfigs/s/Szip/Szip-2.1.1-GCCcore-11.2.0.eb failed (err: 'build failed (first 300 chars): Checksum verification for /cluster/user/hpc-admin/.eb/sources/s/Szip/szip-2.1.1.tar.gz using 21ee958b4f2d4be2c9cabfa5e1a94877043609ce86fde5f286f105f7ff84d412 failed.')

I checked the url and the file seems to be available..

Are these independent errors or are they somehow correlated?

mfruhner commented 9 months ago

Today the mentioned modules built without any problems. What could be the reason for these inconsistent behaviours?

Edit:

No they didnt. Other packages failed. Is this some problem with my setup or a known issue? when using the file command on the downloaded tar.gz files there are varying results. Sometimes the conents are html files (the download page maybe?) and sometimes the command just output 'empty'...

boegel commented 8 months ago

@mfruhner You're probably the victim of the upstream server from which EasyBuild downloads being temporarily unavailable, see https://github.com/easybuilders/easybuild-framework/issues/4382 for example.

It's probably just bad luck...