search

ComputeCanada / software-stack-config

8 stars 3 forks source link

switched back to cache being automatically enabled #35

Closed mboisson closed 2 years ago

mboisson commented 2 years ago

Lmod 8.7.4 has been deployed. You can test that cache is working correctly using: 

export RSNT_ENABLE_LMOD_CACHE="yes"
module --force purge
module load StdEnv/2020
mboisson commented 2 years ago

This is for https://github.com/ComputeCanada/software-stack/issues/110

ofisette commented 2 years ago

This version shows the same behaviour as before: modules in ~/.local/easybuild are not picked up by module spider when the cache is enabled, unless the modules are in the currently loaded toolchain. I tested this on a local AVX cluster, where:

$ module --version

Modules based on Lua: Version 8.7.4  2022-06-07 18:23 -05:00
    by Robert McLay mclay@tacc.utexas.edu
mboisson commented 2 years ago

Do you have a local cache that you are using ? For the new behavior to work, the cache has to be generated with the new version of Lmod (which was done at least for avx2 and avx512, need to check for avx or sse3)

mboisson commented 2 years ago

Ahh, I know what's going on. The caches are being generated at module deployment time, using the version of Lmod that is in production, so caches in production don't contain the information yet (because the new version of Lmod was just deployed).

mboisson commented 2 years ago

I just regenerated the caches with the new version of Lmod. Check again when this returns some matches (there should be one match per module that changes the MODULEPATH): 

 grep changeMPATH /cvmfs/soft.computecanada.ca/custom/lmod/cache/*/spiderT*.lua
ofisette commented 2 years ago

Everything works as expected with the new caches.