icl-utk-edu / magma

BSD 3-Clause "New" or "Revised" License
21 stars 9 forks source link

hipErrorNoBinaryForGpu when built for HIP #11

Open PavelStishenko opened 2 months ago

PavelStishenko commented 2 months ago

I am trying to build MAGMA for HIP on gfx90a GPU (AMD MI210, it's ARCHER2 supercomputer).

I use the following cmake command:

cmake -DMAGMA_ENABLE_CUDA=OFF -DMAGMA_ENABLE_HIP=ON -DCMAKE_LIBRARY_PATH=${CRAY_LIBSCI_PREFIX_DIR}/lib -DCMAKE_CXX_COMPILER=hipcc -DGPU_TARGET=gfx90a -DBUILD_SHARED_LIBS=off -DUSE_FORTRAN=on -DLAPACK_LIBRARIES='-L/opt/cray/pe/libsci/22.12.1.1/AMD/4.0/x86_64/lib -lsci_amd -lsci_amd_mpi -ldl -lhipblas -lhipsparse -lamdhip64' ..

Build goes succesfully, but almost all tests fail with message  "hipErrorNoBinaryForGpu: Unable to find code object for all current devices!"

CMake and Make logs are attached: cmake.log make.log.gz Here is also a log of make with VERBOSE=1 make_VERBOSE.log.gz

lamikr commented 1 month ago

Can you specify some exact test which is failing for you? And could you be able to test by building the rocm_sdk_builder for gfx90a enabled? It includes the latest version of magma and I have not seen that error on radeon devices I have tested. Build instructions:

https://github.com/lamikr/rocm_sdk_builder

After building, this is example how to try out the magma test apps:

 #  source /opr/rocm_sdk_612/bin/env_rocm.sh
 #  cd ocm_sdk_builder_612/builddir/037_magma/testing
 # ./testing_sswap