Closed jcosborn closed 8 months ago
@jcosborn I tried but cannot reproduce the error you are seeing.
tol
by a factor of square root of Ls
.Thanks for looking into it. I saw this on a few different systems with different setups so though it would be easier to reproduce. For completeness here's the configure output for the A100 build. I can try again with different SDKs to see if that changes it.
-- QUDA 1.1.0 (0c016af70) **
-- cmake version: 3.27.2
-- Source location: /home/osborn/lqcd/src/quda-git
-- Build location: /home/osborn/lqcd/build/quda-git
-- Build type: RELEASE
-- QUDA target: CUDA
-- The CXX compiler identification is NVHPC 23.7.0
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /soft/compilers/nvhpc/Linux_x86_64/23.7/compilers/bin/nvc++ - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- The C compiler identification is NVHPC 23.7.0
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: /soft/compilers/nvhpc/Linux_x86_64/23.7/compilers/bin/nvc - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success
-- Found Threads: TRUE
-- CPM: Adding package Eigen@3.4.0 (3.4.0)
-- QUDA_mdw_fused_Ls=4,8,12,16,20
-- QUDA_MULTIGRID_NVEC_LIST=6,24,32
-- QUDA_MULTIGRID_MRHS_LIST=16
-- Found CUDAToolkit: /soft/compilers/nvhpc/Linux_x86_64/23.7/cuda/12.2/include (found version "12.2.91")
-- Building QUDA for GPU ARCH sm_80
-- The CUDA compiler identification is NVIDIA 12.2.91
-- Detecting CUDA compiler ABI info
-- Detecting CUDA compiler ABI info - done
-- Check for working CUDA compiler: /soft/compilers/nvhpc/Linux_x86_64/23.7/compilers/bin/nvcc - skipped
-- Detecting CUDA compile features
-- Detecting CUDA compile features - done
-- CUDA Compiler is/soft/compilers/nvhpc/Linux_x86_64/23.7/compilers/bin/nvcc
-- Compiler ID is NVIDIA
-- CUDA Build Type: NVCC
-- Heterogeneous atomics supported: ON
-- QUDA_MULTIGRID_MRHS_LIST=16
-- Performing Test QUDA_LINKER_COMPRESS
-- Performing Test QUDA_LINKER_COMPRESS - Success
-- Performing Test QUDA_COMPRESS_DEBUG
-- Performing Test QUDA_COMPRESS_DEBUG - Failed
I get the same test failures with CUDA 11.6.2 + GCC 11.1 and CUDA 12.0.0 + GCC 12.2.
invert_test_mobius_eofa_sym_single
andinvert_test_domain_wall_double
from develop branch fail a few tests (4 each) on A100 and Geforce due to the host norm.An example from
invert_test_mobius_eofa_sym_single
is:An example from
invert_test_domain_wall_double
is:I also see some cases where the QUDA residual is larger than the tolerance, but the test still passes. An example from
invert_test_mobius_eofa_sym_single
is: