Open titoiride opened 5 days ago
Hi @titoiride,
This looks like an install issue when heFFTe was installed. How did you build/install heFFTe itself? On which system is this, Perlmutter?
At the moment, heFFTe is just a preview and not on by default. We do not always see better performance with it. You can turn it off.
Thanks for the note! This is the compilation script, which I took from the recommended script and only slightly adapted. Yes, it's on Perlmutter
# heFFTe
if [ -d ${SW_DIR}/heffte ]
then
cd ${SW_DIR}/heffte
git fetch --prune
git checkout v2.4.0
cd -
else
git clone -b v2.4.0 https://github.com/icl-utk-edu/heffte.git ${SW_DIR}/heffte
fi
if [ -d ${build_dir}/heffte-pm-gpu-build ]
then
rm -rf ${build_dir}/heffte-pm-gpu-build
fi
cmake \
-S ${SW_DIR}/heffte \
-B ${build_dir}/heffte-pm-gpu-build \
-DBUILD_SHARED_LIBS=ON \
-DCMAKE_BUILD_TYPE=Release \
-DCMAKE_CXX_STANDARD=17 \
-DCMAKE_INSTALL_RPATH_USE_LINK_PATH=ON \
-DCMAKE_INSTALL_PREFIX=${SW_DIR}/heffte \
-DHeffte_DISABLE_GPU_AWARE_MPI=OFF \
-DHeffte_ENABLE_AVX=OFF \
-DHeffte_ENABLE_AVX512=OFF \
-DHeffte_ENABLE_FFTW=OFF \
-DHeffte_ENABLE_CUDA=ON \
-DHeffte_ENABLE_ROCM=OFF \
-DHeffte_ENABLE_ONEAPI=OFF \
-DHeffte_ENABLE_MKL=OFF \
-DHeffte_ENABLE_DOXYGEN=OFF \
-DHeffte_SEQUENTIAL_TESTING=OFF \
-DHeffte_ENABLE_TESTING=OFF \
-DHeffte_ENABLE_TRACING=OFF \
-DHeffte_ENABLE_PYTHON=OFF \
-DHeffte_ENABLE_FORTRAN=OFF \
-DHeffte_ENABLE_SWIG=OFF \
-DHeffte_ENABLE_MAGMA=OFF
cmake --build ${build_dir}/heffte-pm-gpu-build --target install --parallel 16
rm -rf ${build_dir}/heffte-pm-gpu-build
# work-around for heFFTe 2.4.0 bug with NVCC
# https://github.com/icl-utk-edu/heffte/pull/54
sed -i 's/__AVX__/NOTDEFINED_DONOTUSE/g' ${SW_DIR}/heffte/include/stock_fft/heffte_stock_vec_types.h
Hi all, when I try to build warpx with
-DWarpX_HEFFTE=ON
, I get an error during the cmake configure stage:Opening the file
HeffteConfig.cmake
I find that the first few lines are in factIs this an error where I am passing an incorrect flag and cmake can't substitute the
@PACKAGE_INIT@
variable? I build WarpX with