easybuilders / easybuild-easyconfigs

A collection of easyconfig files that describe which software to build using which build options with EasyBuild.
https://easybuild.io
GNU General Public License v2.0
356 stars 685 forks source link

add patch to SciPy-bundle 2024.05 that fixes numpy test failures on RISC-V #20847

Open bedroge opened 1 week ago

bedroge commented 1 week ago

See https://github.com/numpy/numpy/pull/26743.

Before:

=========================== short test summary info ============================
FAILED core/tests/test_numeric.py::TestBoolCmp::test_float - AssertionError:
FAILED core/tests/test_umath.py::TestFPClass::test_fpclass[-4] - AssertionErr...
FAILED core/tests/test_umath.py::TestFPClass::test_fpclass[-2] - AssertionErr...
FAILED core/tests/test_umath.py::TestFPClass::test_fpclass[-1] - AssertionErr...
FAILED core/tests/test_umath.py::TestFPClass::test_fpclass[1] - AssertionError:
FAILED core/tests/test_umath.py::TestFPClass::test_fp_noncontiguous[f] - Asse...
= 6 failed, 32076 passed, 1746 skipped, 1305 deselected, 31 xfailed, 3 xpassed, 18 warnings in 1008.04s (0:16:48) =

After:

= 32082 passed, 1746 skipped, 1305 deselected, 31 xfailed, 3 xpassed, 18 warnings in 997.29s (0:16:37) =
bedroge commented 1 week ago

@boegelbot please test @ jsc-zen3

boegelbot commented 1 week ago

@bedroge: Request for testing this PR well received on jsczen3l1.int.jsc-zen3.fz-juelich.de

PR test command 'if [[ develop != 'develop' ]]; then EB_BRANCH=develop ./easybuild_develop.sh 2> /dev/null 1>&2; EB_PREFIX=/home/boegelbot/easybuild/develop source init_env_easybuild_develop.sh; fi; EB_PR=20847 EB_ARGS= EB_CONTAINER= EB_REPO=easybuild-easyconfigs EB_BRANCH=develop /opt/software/slurm/bin/sbatch --job-name test_PR_20847 --ntasks=8 ~/boegelbot/eb_from_pr_upload_jsc-zen3.sh' executed!

Test results coming soon (I hope)...

*- notification for comment with ID 2176370352 processed* *Message to humans: this is just bookkeeping information for me, it is of no use to you (unless you think I have a bug, which I don't).*
boegelbot commented 1 week ago

Test report by @boegelbot SUCCESS Build succeeded for 1 out of 1 (1 easyconfigs in total) jsczen3c2.int.jsc-zen3.fz-juelich.de - Linux Rocky Linux 9.4, x86_64, AMD EPYC-Milan Processor (zen3), Python 3.9.18 See https://gist.github.com/boegelbot/16360268607328a10a159ba9a5a67c7a for a full test report.

bedroge commented 1 week ago

@boegelbot please test @ generoso

boegelbot commented 1 week ago

@bedroge: Request for testing this PR well received on login1

PR test command 'EB_PR=20847 EB_ARGS= EB_CONTAINER= EB_REPO=easybuild-easyconfigs /opt/software/slurm/bin/sbatch --job-name test_PR_20847 --ntasks=4 ~/boegelbot/eb_from_pr_upload_generoso.sh' executed!

Test results coming soon (I hope)...

*- notification for comment with ID 2176527637 processed* *Message to humans: this is just bookkeeping information for me, it is of no use to you (unless you think I have a bug, which I don't).*
bedroge commented 1 week ago

Test report by @bedroge FAILED Build succeeded for 0 out of 1 (1 easyconfigs in total) starfive - Linux Debian GNU/Linux n/a, RISC-V-64, UNKNOWN, Python 3.10.9 See https://gist.github.com/bedroge/70e6640bae6d152d57947a439aa8418d for a full test report.

Build and tests of numpy succeeded, but now scipy seems to have test failures.

boegelbot commented 1 week ago

Test report by @boegelbot SUCCESS Build succeeded for 1 out of 1 (1 easyconfigs in total) cns2 - Linux Rocky Linux 8.9, x86_64, Intel(R) Xeon(R) CPU E5-2667 v3 @ 3.20GHz (haswell), Python 3.6.8 See https://gist.github.com/boegelbot/d5757b2d61d34d06807c47ad305e0643 for a full test report.

bedroge commented 1 week ago

Test report by @bedroge FAILED Build succeeded for 0 out of 1 (1 easyconfigs in total) starfive - Linux Debian GNU/Linux n/a, RISC-V-64, UNKNOWN, Python 3.10.9 See https://gist.github.com/bedroge/70e6640bae6d152d57947a439aa8418d for a full test report.

Build and tests of numpy succeeded, but now scipy seems to have test failures.

Ah, the output just stopped here:

scipy/linalg/tests/test_matfuncs.py::TestSignM::test_defective2 PASSED   [ 19%]
scipy/linalg/tests/test_matfuncs.py::TestSignM::test_defective3 PASSED   [ 19%]
scipy/linalg/tests/test_matfuncs.py::TestLogM::test_nils

and couldn't really find any clues, but it turns out it ran out of memory:

[Tue Jun 18 17:30:32 2024] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),task=python,pid=1215221,uid=1000
[Tue Jun 18 17:30:32 2024] Out of memory: Killed process 1215221 (python) total-vm:9440708kB, anon-rss:7407096kB, file-rss:8kB, shmem-rss:0kB, UID:1000 pgtables:14872kB oom_score_adj:0

Tried it a second time, but then the same thing happened again.