search

sandialabs / Albany

Sandia National Laboratories' Albany multiphysics code
Other
282 stars 89 forks source link

Enable uvm-free testing on Perlmutter #1022

Closed mcarlson801 closed 11 months ago

mcarlson801 commented 12 months ago

This PR does the following:

1) Adds the ALBANY_ENABLE_CUDA_UVM flag so that CUDA testing can be separated into uvm-on and uvm-off 2) For uvm-off CUDA builds, enables a small selection of tests that either are currently passing when uvm is off or will be passing in the very near future 3) Adds portable (_kokkos) versions of MueLu FO_AIS and FO_GIS tests. (I need to port solution average response to get these to pass so that will be the next step) 4) Updates to Perlmutter automated testing scripts (some modules needed to be updated after this week's maintenance and some minor general fixes to automation scripts) 5) Added uvm-off build and test to Perlmutter dashboard (uvm-on build is now named pm-gpu-uvm and uvm-off build is named pm-gpu)

jewatkins commented 11 months ago

Just fyi, since you removed KOKKOS_COMPILER_CUDA_VERSION, you should remove it from src/Albany_Utils.cpp where the value dumps at runtime. I still find it useful (I sometimes use it to make sure my sim was using the correct cuda version) so it would be great to have a replacement for that line.

jewatkins commented 11 months ago

wait... I guess we're already pulling this from kokkos? so maybe it's okay. I guess I'll find out the next time I look at a cuda run.

jewatkins commented 11 months ago

I did a little more digging and it looks like this has been broken for a while (not sure when it stopped working, sometime in the last year). I'll probably revive it at some point.