search

cnr-ibf-pa / hbp-bsp-issues

Ticketing system for developers/testers and power users of the Brain Simulation Platform of the Human Brain Project
4 stars 0 forks source link

Redeploy new stack on PizDaint after the maintenance on 9th of September 2020 #551

Closed clupascu closed 3 years ago

clupascu commented 3 years ago

Expected behavior

loading modules without problems

Actual Behavior (please include screenshot if possible)

Python is updated from 3.6 to 3.8. The module cray-python/3.6.5.7 is removed and replaced with cray-python/3.8.2.1. Any virtual environments created using cray-python/3.6.5.7 will need to be recreated with the updated version of Python. Softwares must be recompiled.

Steps to reproduce the problem

On PizDaint module load daint-mc cray-python/3.6.5.7 PyExtensions/3.6.5.7-CrayGNU-19.10

Optional infrastructural data (user, platform, browser, environment, ...)

PizDaint

ElisabettaGiacalone commented 3 years ago

Hi @pramodk do you have any update on this issue? We are blocked in our Hippocampus exploitation campaign due to this issue.

pramodk commented 3 years ago

@jorblancoa has been working on this since yesterday. It's taking some time because all software stack and system packages are updated during last maintenance. He will update here soon.

jorblancoa commented 3 years ago

I have finished the deployment and validation of the new modules on Piz Daint after the maintenance. You can find the instructions in the wiki, but apart from new version on some python modules the main change in your scripts would be:

module load daint-mc cray-python/3.8.2.1 PyExtensions/python3-CrayGNU-20.08 module use /apps/hbp/ich002/hbp-spack-deployments/softwares/15-09-2020/install/modules/tcl/cray-cnl7-haswell

CC: @clupascu @ElisabettaGiacalone @wvangeit @mmigliore @antonelepfl

jdcourcol commented 3 years ago

@clupascu can this be closed ?

clupascu commented 3 years ago

@jdcourcol I am still waiting for some confirmations on the good functioning of the new modules. I will close it when the tests will be finished.

clupascu commented 3 years ago

@jorblancoa I did some tests on PizDaint and when I submit a job using in my .sbatch file

module load daint-mc cray-python/3.8.2.1 PyExtensions/python3-CrayGNU-20.08 module use /apps/hbp/ich002/hbp-spack-deployments/softwares/15-09-2020/install/modules/tcl/cray-cnl7-haswell module load neuron/7.8.0c module load py-bluepyopt nrnivmodl mechanisms

I get at some point

/bin/sh: CC: command not found make: *** [/apps/hbp/ich002/hbp-spack-deployments/softwares/15-09-2020/install/install/cray-cnl7-haswell/intel-19.0.1.144/neuron-7.8.0c-xzcirp/bin/nrnmech_makefile:77: x86_64/libnrnmech.so] Error 127

and moreover

ModuleNotFoundError: No module named 'matplotlib'

Any suggestion?

clupascu commented 3 years ago

It seems the above error is due to

ModuleCmd_Load.c(244):ERROR:105: Unable to locate a modulefile for 'daint-mc' cray-python/3.8.2.1(45):ERROR:105: Unable to locate a modulefile for 'PyExtensions/python3-CrayGNU-20.08'

when the job is submitted through Unicore. Otherwise the new modules work perfectly. I will close this issue.

jorblancoa commented 3 years ago

Sorry for being late answering here. Yesterday I tried to reproduce the errors you were getting and I didn't manage, so I wanted to investigate further today. I'm glad you found the root of the issue.

Cheers, Jorge

clupascu commented 3 years ago

Thank you @jorblancoa

Cheers, Carmen