search

desihub / desimodules

Maintain the default set of DESI product versions and environment modules loaded.
BSD 3-Clause "New" or "Revised" License
0 stars 1 forks source link

Numbered releases broken on cori #25

Closed dkirkby closed 6 years ago

dkirkby commented 6 years ago

I just noticed that the following command fails:

dkirkby@cori09:~> source /project/projectdirs/desi/software/desi_environment.sh 18.1
gcc(3):ERROR:105: Unable to locate a modulefile for 'gcc/6.2.0'
...

All numbered releases (17.12, 17.9, ...) fail the same way, but the default (master) works.

Is this a transient problem or are others seeing the same thing?

sbailey commented 6 years ago

More recent releases work: 18.3, 18.6, 18.7.

Unfortunately NERSC removed a module that we previously required. In the past we have sometimes gotten them to re-instantiate a removed module, but this flavor of problem will always be an issue when working at NERSC where we don't control the upgrade path for core modules like gcc.

Suggestions welcome.

dkirkby commented 6 years ago

I didn't try those since I didn't see them listed in /global/common/cori/contrib/desi/desiconda/startup/modulefiles/desimodules/.

weaverba137 commented 6 years ago

That path is outdated. The standard DESI software path is now /global/common/software/desi/${NERSC_HOST}.

sbailey commented 6 years ago

Ah, that is an old and deprecated location. NERSC asked us to move here: /global/common/software/desi/cori/desiconda/startup/modulefiles/desimodules/. One dangling action item is to remove those old locations (with warnings and instructions for what people should do instead).

sbailey commented 6 years ago

Cross post. My reply was in reference to @dkirkby not @weaverba137 . /global/common/software/desi/${NERSC_HOST} is the new location as he noted.

dkirkby commented 6 years ago

Ok, thanks. The old locations are still used by /project/projectdirs/desi/software/desi_environment.sh for 17.* and 18.1, but perhaps that's unnecessary since those releases exist under the new location?

sbailey commented 6 years ago

Workaround to get 18.1 and prior, thanks to @rcthomas 

module load pe_archive
source /project/projectdirs/desi/software/desi_environment.sh 18.1
weaverba137 commented 6 years ago

@sbailey, should we close this with the existing workaround, or do we need to include this in the 18.9 version of desimodules?

sbailey commented 6 years ago

We should not need this for 18.9. I think the workaround is ok for the old versions. If it keeps coming up, we could retroactively add "module load pe_archive" to the old module files, but let's not do that right now.