easybuilders / easybuild-easyconfigs

A collection of easyconfig files that describe which software to build using which build options with EasyBuild.
https://easybuild.io
GNU General Public License v2.0
380 stars 704 forks source link

OpenFOAM-9-foss-2021a fails to work and install #15069

Open moravveji opened 2 years ago

moravveji commented 2 years ago

Hi

We have a user on Breniac who wants to use OpenFOAM/9. When he tries the module from the 2019b toolchain and use paraFoam, he gets an error attached in err-19b.jpeg. So, I pulled the .eb file and installed OpenFOAM/9 on 2021a toolchain. This time, the user gets somehow different error; see err-21a.jpeg. Obviously, in either case, the problems go around ParaView.

To remedy that, I included the libxcb/1.13-GCCcore-10.3.0 to the dependency list, and tried to recompile it; however, this time, the build fails totally (with and without libxcb). Hence, I cannot reproduce my earlier compilation anymore. The error message is:

== building...
== FAILED: Installation ended unsuccessfully (build directory: /apps/leuven/skylake/2021a/software/OpenFOAM/9-foss-2021a): build failed (first 300 chars): cmd "source /apps/leuven/skylake/2021a/software/OpenFOAM/9-foss-2021a/OpenFOAM-9/etc/bashrc && cd $WM_PROJECT_DIR && wcleanPlatform -all && cd - &&
 /apps/leuven/skylake/2021a/software/OpenFOAM/9-foss-2021a/OpenFOAM-9/Allwmake" exited with exit code 1 and output:
Removing all platforms/sub-directori (took 2 min 33 sec)
== Results of the build can be found in the log file(s) /tmp/eb-HTtWZH/easybuild-OpenFOAM-9-20220301.154814.gMZdr.log
ERROR: Build of /vsc-hard-mounts/leuven-data/sys/x0090231/easybuild/work/OpenFOAM/from-eb/OpenFOAM-9-foss-2021a.eb failed (err: 'build failed (first 300 chars): cmd "source /apps/leuven/skylake/2021a/software/OpenFOAM/9-foss-2021a/OpenFOAM-9/etc/bashrc && cd $WM_PROJECT_DIR && wcleanPlatform -all && cd - &&  /apps/leuven/skylake/2021a/software/OpenFOAM/9-foss-2021a/OpenFOAM-9/Allwmake" exited with exit code 1 and output:\nRemoving all platforms/sub-directori')

I have attached all useful stuff.

So, my questions are:

Kind regards Ehsan err-19b err-21a of9-foss-2021a.tar.gz

catalinbostan commented 2 years ago

very strange...

  1. first install failed , with : [100%] Built target libPVFoamReader_SM (at easybuild/tools/run.py:618 in parse_cmd_output) == 2022-04-02 15:27:21,251 build_log.py:265 INFO ... (took 18 mins 5 secs) == 2022-04-02 15:27:21,251 filetools.py:1983 INFO Removing lock /cm/shared/apps/easy/software/.locks/_cm_shared_apps_easy_software_OpenFOAM_9-foss-2021a.lock... == 2022-04-02 15:27:21,252 filetools.py:382 INFO Path /cm/shared/apps/easy/software/.locks/_cm_shared_apps_easy_software_OpenFOAM_9-foss-2021a.lock successfully removed. == 2022-04-02 15:27:21,252 filetools.py:1987 INFO Lock removed: /cm/shared/apps/easy/software/.locks/_cm_shared_apps_easy_software_OpenFOAM_9-foss-2021a.lock == 2022-04-02 15:27:21,252 easyblock.py:4077 WARNING build failed (first 300 chars): cmd "source /cm/shared/apps/easy/software/OpenFOAM/9-foss-2021a/OpenFOAM-9/etc/bashrc && cd $WM_PROJECT_DIR && wcleanPlatform -all && cd - && /cm/shared/apps/easy/software/OpenFOAM/9-foss-2021a/OpenFOAM-9/Allwmake" exited with exit code 2 and output: Removing all platforms/sub-directories Removing == 2022-04-02 15:27:21,252 easyblock.py:318 INFO Closing log for application name OpenFOAM version 9

  2. second install succesfull -executed with the same command ... easyblock.py:4125 INFO Build stats: OrderedDict([('easybuild-framework_version', '4.5.4'), ('easybuild-easyblocks_version', '4.5.4'), ('timestamp', 1648923307), ('build_time', 1261.41), ('install_size', 1571804671), ('command_line', ["--installpath='/cm/shared/apps/easy'", "--module-syntax='Tcl'", "--modules-tool='EnvironmentModules'", "--robot='/home/cataprosys/py3venv-easy/easybuild/easyconfigs'", '--trace', 'OpenFOAM-9-foss-2021a.eb']), ('modules_tool', ('Environment Modules', '/cm/local/apps/environment-modules/4.5.3/libexec/modulecmd.tcl', '4.5.3')), ('core_count', 64), ('cpu_arch', 'x86_64'), ('cpu_arch_name', 'UNKNOWN'), ('cpu_model', 'AMD EPYC 7452 32-Core Processor'), ('cpu_speed', 2350.0), ('cpu_vendor', 'AMD'), ('gcc_version', 'Using built-in specs.; COLLECT_GCC=gcc; COLLECT_LTO_WRAPPER=/cm/shared/apps/easy/software/GCCcore/10.3.0/libexec/gcc/x86_64-pc-linux-gnu/10.3.0/lto-wrapper; OFFLOAD_TARGET_NAMES=nvptx-none; Target: x86_64-pc-linux-gnu; Configured with: ../configure --enable-languages=c,c++,fortran --without-cuda-driver --enable-offload-targets=nvptx-none --enable-lto --enable-checking=release --disable-multilib --enable-shared=yes --enable-static=yes --enable-threads=posix --enable-plugins --enable-gold=default --enable-ld --with-plugin-ld=ld.gold --prefix=/cm/shared/apps/easy/software/GCCcore/10.3.0 --with-local-prefix=/cm/shared/apps/easy/software/GCCcore/10.3.0 --enable-bootstrap --with-isl=/home/cataprosys/.local/easybuild/build/GCCcore/10.3.0/system-system/gcc-10.3.0/stage2_stuff --build=x86_64-pc-linux-gnu --host=x86_64-pc-linux-gnu; Thread model: posix; Supported LTO compression algorithms: zlib; gcc version 10.3.0 (GCC) ; '), ('glibc_version', '2.17'), ('hostname', 'head'), ('os_name', 'CentOS Linux'), ('os_type', 'Linux'), ('os_version', '7.9.2009'), ('platform_name', 'x86_64-unknown-linux'), ('python_version', '3.6.8 (default, Nov 16 2020, 16:55:22) ; [GCC 4.8.5 20150623 (Red Hat 4.8.5-44)]'), ('system_gcc_path', '/cm/shared/apps/easy/software/GCCcore/10.3.0/bin/gcc'), ('system_python_path', '/cm/shared/apps/easy/software/Python/3.9.5-GCCcore-10.3.0/bin/python'), ('total_memory', 257612)]) == 2022-04-02 21:15:08,228 filetools.py:2708 INFO /tmp/eb-s3h_yj67/reprod_20220402205406_252875 moved to /cm/shared/apps/easy/software/OpenFOAM/9-foss-2021a/easybuild/reprod == 2022-04-02 21:15:08,228 easyblock.py:4135 INFO Wrote files for reproducibility to /cm/shared/apps/easy/software/OpenFOAM/9-foss-2021a/easybuild/reprod == 2022-04-02 21:15:08,230 filetools.py:1882 INFO Creating directory /home/cataprosys/.local/easybuild/ebfiles_repo/OpenFOAM (parents: True, set_gid: False, sticky: False) == 2022-04-02 21:15:08,230 filetools.py:2395 INFO /home/cataprosys/py3venv-easy/easybuild/easyconfigs/o/OpenFOAM/OpenFOAM-9-cleanup.patch copied to /home/cataprosys/.local/easybuild/ebfiles_repo/OpenFOAM/OpenFOAM-9-cleanup.patch == 2022-04-02 21:15:08,231 easyblock.py:318 INFO Closing log for application name OpenFOAM version 9

I can send full log for both installs -if you neeed these

moravveji commented 2 years ago

@catalinbostan very strange, indeed. The reason for the 1st failure is unknown to me. Any verbose logs? Did you use the .eb file I attached? Else, could you please share your EasyConfig file?

catalinbostan commented 2 years ago
  1. Used "standard" eb file from eb 4.5.4. bellow is eb file cat /cm/shared/apps/easy/software/OpenFOAM/9-foss-2021a/easybuild/reprod/OpenFOAM-9-foss-2021a.eb

name = 'OpenFOAM' version = '9'

homepage = 'https://www.openfoam.org/' description = """OpenFOAM is a free, open source CFD software package. OpenFOAM has an extensive range of features to solve anything from complex fluid flows involving chemical reactions, turbulence and heat transfer, to solid dynamics and electromagnetics."""

toolchain = {'name': 'foss', 'version': '2021a'}

source_urls = ['https://github.com/%(name)s/%(name)s-%(version_major)s/archive'] sources = ['version-%(version)s.tar.gz'] patches = ['%(name)s-%(version)s-cleanup.patch'] checksums = [ '0c48fb56e2fbb4dd534112811364d3b2dc12106e670a6486b361e4f864b435ee', # version-9.tar.gz '4b638891f32badde1a5b1b364bc3bd5e0eda180b9d9a8afdf797d5818b8b494e', # %(name)s-9-cleanup.patch ]

builddependencies = [ ('Bison', '3.7.6', '', ('GCCcore', '10.3.0')), ('CMake', '3.20.1', '', ('GCCcore', '10.3.0')), ('flex', '2.6.4', '', ('GCCcore', '10.3.0')), ] dependencies = [ ('libreadline', '8.1', '', ('GCCcore', '10.3.0')), ('ncurses', '6.2', '', ('GCCcore', '10.3.0')), ('METIS', '5.1.0', '', ('GCCcore', '10.3.0')), ('SCOTCH', '6.1.0', '', ('gompi', '2021a')), ('CGAL', '4.14.3', '', ('gompi', '2021a')), ('ParaView', '5.9.1', '-mpi'), ('gnuplot', '5.4.2', '', ('GCCcore', '10.3.0')), ]

moduleclass = 'cae'

.config file

cat .config/easybuild/config.cfg [MAIN]

[basic]

[config]

Install path for software and modules (default: /home/cataprosys/.local/easybuild)

installpath=/cm/shared/apps/easy

Syntax to be used for module files (type choice; default: Lua) (choices: Lua, Tcl)

module-syntax=Tcl

Modules tool to use (type choice; default: Lmod) (choices: EnvironmentModules, EnvironmentModulesC, EnvironmentModulesTcl, Lmod)

modules-tool=EnvironmentModules

[container]

[easyconfig]

[github]

[informative]

[job]

[override]

[package]

[regtest]

[software]

[unittest]