GPTune Installation Problem

gptune / GPTune

Other

64 stars 18 forks source link

GPTune Installation Problem #6

Closed haoyunl2 closed 2 years ago

haoyunl2 commented 2 years ago

I am using NERSC Cori Supercomputer. When I try to use the script config_cori.sh to install GPTune, some modules fail to be installed, especially module GPy. The error is attached below. Then, the C compiler cannot recognize the projects in the "examples" folder. The screenshot is also attached. Could you please take a look at the issue I encounter. Thanks!

liuyangzhuan commented 2 years ago

Have you changed anything of that script?

If you add "module list" at line 256 and comment out all lines after. What does module list show you? You should have PrgEnv-gnu loaded, but apparently intel compiler is somehow still in effect.

haoyunl2 commented 2 years ago

I have changed the python version from 3.7 to 3.8. Module list screen is attached below. PrgEnv-gnu is loaded, and PrgEnv-intel is unloaded.

younghyunc commented 2 years ago

@liuyangzhuan, I've talked about this problem with @haoyunl2 earlier. Let me add one comment that "cori-haswell-openmpi-intel" setting works for @haoyunl2's environment, but installation fails when using "cori-haswell-openmpi-gnu". I advised @haoyunl2 to use "cori-haswell-openmpi-intel" for now, but it would be good to figure this out.

liuyangzhuan commented 2 years ago

@younghyunc Thanks for the explanation. I do see there is some permission issue regarding scikit-learn and gptune installation path when using python 3.8. I made some fixes in https://github.com/gptune/GPTune/commit/67b1abb4cbd30417e5e0adf2f25a7102d278bffd and bump the python version to 3.8.

Can you try it again? @haoyunl2

haoyunl2 commented 2 years ago

Thanks for the reply and update. But the problem for GPy still exists. The screenshots are attached. But, I found that if I re-install the module that fails to complete when running the installation script cofig_cori.sh manually. Then the code can be run on the GNU compiler.

liuyangzhuan commented 2 years ago

Glad it worked out for you. I don't know why icc is still picked for the GPy installation. It seems that a clean rebuild fixed the problem. I will close this issue now.