search

AdaptiveComputationLab / simcov

Other
5 stars 10 forks source link

Build error :( #15

Closed abbypribis closed 3 years ago

abbypribis commented 3 years ago

I got the following error when trying to run simcov. I have a feeling that it is a CARC problem, so I will open a ticket with them on Monday, but I just wanted to check here too and make the issue known:

First, I made sure that my local directory matched this directory:

[apribis@xena simcov]$ git status On branch master nothing to commit, working directory clean

Then, I ran the default Xena script in batch-scripts/carc/xena_simcov_run.sh, and I got this error:

You have not been allocated GPUs. To request GPUs, add the following to your submission script (where X is the number of GPUs to request): #SBATCH --gres=gpu:X

Error: "./install/bin/simcov" does not appear to execute a UPC++/GASNet executable usage: upcxx-run [-h] [-n NUM] [-N NUM] [-shared-heap HEAPSZ] [-backtrace] [-show] [-info] [-ssh-servers HOSTS] [-localhost] [-v] [-E VAR1[,VAR2]] command ...

This seems to indicate the script must be modified to allocate GPUs, but the error below looks like UPC++ was not installed correctly. Therefore, I tried rebuilding:

[apribis@xena simcov]$ module load upcxx/2020.10.0-python3-3o75

The following have been reloaded with a version change: 1) zlib/1.2.11-pkmj => zlib/1.2.11-lfst

[apribis@xena simcov]$ ./build.sh Release ./build.sh: line 41: cmake: command not found [apribis@xena simcov]$ module load cmake/3.18.4-2lmi [apribis@xena simcov]$ ./build.sh Release -- The C compiler identification is GNU 10.2.0 -- The CXX compiler identification is GNU 10.2.0 -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Check for working C compiler: /opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/gcc - skipped -- Detecting C compile features -- Detecting C compile features - done -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Check for working CXX compiler: /opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++ - skipped -- Detecting CXX compile features -- Detecting CXX compile features - done Building Release version -- Submodule update of upcxx-utils -- 37018525d0c4a97650fe01947de1d9fe4dd99499 upcxx-utils (v0.3.0-29-g3701852) matched '^ .* upcxx-utils' -- SIMCOV base version 0.1.1 (0.1.1) -- SIMCOV_BUILD_DATE=20201211_184439 -- No external upcxx-utils package provided -- CMAKE_MODULE_PATH: /users/apribis/simcov/cmake/Modules -- Did not find an installation of upcxx_utils, including submodule in src/upcxx_utils -- Building for Release -- UPCXX_UTILS base version 0.3.0 (0.3.0) -- UPCXX_UTILS_BUILD_DATE=20201211_184439 -- Testing the environment.. -- Found UPCXX: /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/bin/upcxx-meta -- Found UPCXX: /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/bin/upcxx-meta CMake Warning at /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/share/cmake/UPCXX/UPCXXConfig.cmake:129 (message): Compiler compatibility check failed!

UPCXX compiler provided by upcxx-meta CXX:

  /opt/intel/compilers_and_libraries_2020.2.254/linux/mpi/intel64/bin/mpicxx ->
  /opt/intel/compilers_and_libraries_2020.2.254/linux/mpi/intel64/bin/mpicxx

is different from CMAKE_CXX_COMPILER:

  /opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++ ->
  /opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++

Please either pass cmake: -DCMAKE_CXX_COMPILER=/opt/intel/compilers_and_libraries_2020.2.254/linux/mpi/intel64/bin/mpicxx

or re-install UPC++ with: CXX=/opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++

Call Stack (most recent call first): upcxx-utils/CMakeLists.txt:76 (find_package)

-- Could NOT find UPCXX (missing: UPCXX_COMPATIBLE_COMPILER) (found version "2020.10.0") -- This UPC++ install requires the c++11 standard. -- UPCXX_NETWORK=smp -- UPCXX_THREADMODE=seq -- UPCXX_CODEMODE=O3 CMake Warning at upcxx-utils/CMakeLists.txt:76 (find_package): Found package configuration file:

/opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/share/cmake/UPCXX/UPCXXConfig.cmake

but it set UPCXX_FOUND to FALSE so package "UPCXX" is considered to be NOT FOUND.

-- Using UPCXX version - 2020.10.0 20201000 -- Looking for pthread.h -- Looking for pthread.h - found -- Performing Test CMAKE_HAVE_LIBC_PTHREAD -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed -- Looking for pthread_create in pthreads -- Looking for pthread_create in pthreads - not found -- Looking for pthread_create in pthread -- Looking for pthread_create in pthread - found -- Found Threads: TRUE
-- UPCXX_UTILS is using the UPCXX::upcxx library interface: -L/opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/upcxx.opt.gasnet_seq.smp/lib -lupcxx -L/opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/gasnet.opt/lib -lgasnet-smp-seq -lrt -L/opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/lib/gcc/x86_64-pc-linux-gnu/10.2.0 -lgcc -lm -- Found UPCXX: /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/bin/upcxx-meta -- Found UPCXX: /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/bin/upcxx-meta CMake Warning at /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/share/cmake/UPCXX/UPCXXConfig.cmake:129 (message): Compiler compatibility check failed!

UPCXX compiler provided by upcxx-meta CXX:

  /opt/intel/compilers_and_libraries_2020.2.254/linux/mpi/intel64/bin/mpicxx ->
  /opt/intel/compilers_and_libraries_2020.2.254/linux/mpi/intel64/bin/mpicxx

is different from CMAKE_CXX_COMPILER:

  /opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++ ->
  /opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++

Please either pass cmake: -DCMAKE_CXX_COMPILER=/opt/intel/compilers_and_libraries_2020.2.254/linux/mpi/intel64/bin/mpicxx

or re-install UPC++ with: CXX=/opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++

Call Stack (most recent call first): upcxx-utils/test/CMakeLists.txt:2 (find_package)

-- Could NOT find UPCXX (missing: UPCXX_COMPATIBLE_COMPILER) (found version "2020.10.0") -- This UPC++ install requires the c++11 standard. -- UPCXX_NETWORK=smp -- UPCXX_THREADMODE=seq -- UPCXX_CODEMODE=O3 CMake Warning at upcxx-utils/test/CMakeLists.txt:2 (find_package): Found package configuration file:

/opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/share/cmake/UPCXX/UPCXXConfig.cmake

but it set UPCXX_FOUND to FALSE so package "UPCXX" is considered to be NOT FOUND.

-- Installing package version 0.3.0 -- UPCXX_UTILS-utils build type: Release -- added upcxx_utils () -- finding UPCXX for SimCov build -- Found UPCXX: /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/bin/upcxx-meta -- Found UPCXX: /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/bin/upcxx-meta CMake Warning at /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/share/cmake/UPCXX/UPCXXConfig.cmake:129 (message): Compiler compatibility check failed!

UPCXX compiler provided by upcxx-meta CXX:

  /opt/intel/compilers_and_libraries_2020.2.254/linux/mpi/intel64/bin/mpicxx ->
  /opt/intel/compilers_and_libraries_2020.2.254/linux/mpi/intel64/bin/mpicxx

is different from CMAKE_CXX_COMPILER:

  /opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++ ->
  /opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++

Please either pass cmake: -DCMAKE_CXX_COMPILER=/opt/intel/compilers_and_libraries_2020.2.254/linux/mpi/intel64/bin/mpicxx

or re-install UPC++ with: CXX=/opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++

Call Stack (most recent call first): src/CMakeLists.txt:5 (find_package)

CMake Error at /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/cmake-3.18.4-2lmiaz6aejwfswraarbhj37mdvspumnw/share/cmake-3.18/Modules/FindPackageHandleStandardArgs.cmake:165 (message): Could NOT find UPCXX (missing: UPCXX_COMPATIBLE_COMPILER) (found version "2020.10.0") Call Stack (most recent call first): /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/cmake-3.18.4-2lmiaz6aejwfswraarbhj37mdvspumnw/share/cmake-3.18/Modules/FindPackageHandleStandardArgs.cmake:458 (_FPHSA_FAILURE_MESSAGE) /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/share/cmake/UPCXX/UPCXXConfig.cmake:269 (find_package_handle_standard_args) src/CMakeLists.txt:5 (find_package)

-- Configuring incomplete, errors occurred! See also "/users/apribis/simcov/.build/CMakeFiles/CMakeOutput.log". See also "/users/apribis/simcov/.build/CMakeFiles/CMakeError.log".

I put the two log files ( /users/apribis/simcov/.build/CMakeFiles/CMakeOutput.log and /users/apribis/simcov/.build/CMakeFiles/CMakeError.log) in this directory: https://drive.google.com/drive/folders/1wVpO435f6r1QnqI-wUUrZ2y0zLsDMbR0?usp=sharing

stevenhofmeyr commented 3 years ago

Abby,

I see two errors:

First, it appears that the upcxx-utils submodule is not there. In the repo root you need to run

git submodule init git submodule update

Second, there is some issue with the cmake configuration vs the upcxx configuration.

Let's solve the first problem first and then see what we have.

I think the GPU warning is not relevant - simcov doesn't use gpus and it seems that's just tge scheduler warning you that you haven't got any GPU allocations.

Steve

On Fri, Dec 11, 2020, 19:40 Abby Pribisova notifications@github.com wrote:

I got the following error when trying to run simcov. I have a feeling that it is a CARC problem, so I will open a ticket with them on Monday, but I just wanted to check here too and make the issue known:

First, I made sure that my local directory matched this directory:

[apribis@xena simcov]$ git status On branch master nothing to commit, working directory clean

Then, I ran the default Xena script in batch-scripts/carc/xena_simcov_run.sh, and I got this error:

You have not been allocated GPUs. To request GPUs, add the following to your submission script (where X is the number of GPUs to request): #SBATCH --gres=gpu:X

Error: "./install/bin/simcov" does not appear to execute a UPC++/GASNet executable usage: upcxx-run [-h] [-n NUM] [-N NUM] [-shared-heap HEAPSZ] [-backtrace] [-show] [-info] [-ssh-servers HOSTS] [-localhost] [-v] [-E VAR1[,VAR2]] command ...

This seems to indicate the script must be modified to allocate GPUs, but the error below looks like UPC++ was not installed correctly. Therefore, I tried rebuilding:

[apribis@xena simcov]$ module load upcxx/2020.10.0-python3-3o75

The following have been reloaded with a version change:

  1. zlib/1.2.11-pkmj => zlib/1.2.11-lfst

[apribis@xena simcov]$ ./build.sh Release ./build.sh: line 41: cmake: command not found [apribis@xena simcov]$ module load cmake/3.18.4-2lmi [apribis@xena simcov]$ ./build.sh Release -- The C compiler identification is GNU 10.2.0 -- The CXX compiler identification is GNU 10.2.0 -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Check for working C compiler: /opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/gcc

  • skipped -- Detecting C compile features -- Detecting C compile features - done -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Check for working CXX compiler: /opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++
  • skipped -- Detecting CXX compile features -- Detecting CXX compile features - done Building Release version -- Submodule update of upcxx-utils -- 37018525d0c4a97650fe01947de1d9fe4dd99499 upcxx-utils (v0.3.0-29-g3701852) matched '^ .* upcxx-utils' -- SIMCOV base version 0.1.1 (0.1.1) -- SIMCOV_BUILD_DATE=20201211_184439 -- No external upcxx-utils package provided -- CMAKE_MODULE_PATH: /users/apribis/simcov/cmake/Modules -- Did not find an installation of upcxx_utils, including submodule in src/upcxx_utils -- Building for Release -- UPCXX_UTILS base version 0.3.0 (0.3.0) -- UPCXX_UTILS_BUILD_DATE=20201211_184439 -- Testing the environment.. -- Found UPCXX: /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/bin/upcxx-meta -- Found UPCXX: /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/bin/upcxx-meta CMake Warning at /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/share/cmake/UPCXX/UPCXXConfig.cmake:129 (message): Compiler compatibility check failed!

UPCXX compiler provided by upcxx-meta CXX:

/opt/intel/compilers_and_libraries_2020.2.254/linux/mpi/intel64/bin/mpicxx -> /opt/intel/compilers_and_libraries_2020.2.254/linux/mpi/intel64/bin/mpicxx

is different from CMAKE_CXX_COMPILER:

/opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++ -> /opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++

Please either pass cmake:

-DCMAKE_CXX_COMPILER=/opt/intel/compilers_and_libraries_2020.2.254/linux/mpi/intel64/bin/mpicxx

or re-install UPC++ with:

CXX=/opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++

Call Stack (most recent call first): upcxx-utils/CMakeLists.txt:76 (find_package)

-- Could NOT find UPCXX (missing: UPCXX_COMPATIBLE_COMPILER) (found version "2020.10.0") -- This UPC++ install requires the c++11 standard. -- UPCXX_NETWORK=smp -- UPCXX_THREADMODE=seq -- UPCXX_CODEMODE=O3 CMake Warning at upcxx-utils/CMakeLists.txt:76 (find_package): Found package configuration file:

/opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/share/cmake/UPCXX/UPCXXConfig.cmake

but it set UPCXX_FOUND to FALSE so package "UPCXX" is considered to be NOT FOUND.

-- Using UPCXX version - 2020.10.0 20201000 -- Looking for pthread.h -- Looking for pthread.h - found -- Performing Test CMAKE_HAVE_LIBC_PTHREAD -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed -- Looking for pthread_create in pthreads -- Looking for pthread_create in pthreads - not found -- Looking for pthread_create in pthread -- Looking for pthread_create in pthread - found -- Found Threads: TRUE -- UPCXX_UTILS is using the UPCXX::upcxx library interface: -L/opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/upcxx.opt.gasnet_seq.smp/lib -lupcxx -L/opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/gasnet.opt/lib -lgasnet-smp-seq -lrt -L/opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/lib/gcc/x86_64-pc-linux-gnu/10.2.0 -lgcc -lm -- Found UPCXX: /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/bin/upcxx-meta -- Found UPCXX: /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/bin/upcxx-meta CMake Warning at /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/share/cmake/UPCXX/UPCXXConfig.cmake:129 (message): Compiler compatibility check failed!

UPCXX compiler provided by upcxx-meta CXX:

/opt/intel/compilers_and_libraries_2020.2.254/linux/mpi/intel64/bin/mpicxx -> /opt/intel/compilers_and_libraries_2020.2.254/linux/mpi/intel64/bin/mpicxx

is different from CMAKE_CXX_COMPILER:

/opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++ -> /opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++

Please either pass cmake:

-DCMAKE_CXX_COMPILER=/opt/intel/compilers_and_libraries_2020.2.254/linux/mpi/intel64/bin/mpicxx

or re-install UPC++ with:

CXX=/opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++

Call Stack (most recent call first): upcxx-utils/test/CMakeLists.txt:2 (find_package)

-- Could NOT find UPCXX (missing: UPCXX_COMPATIBLE_COMPILER) (found version "2020.10.0") -- This UPC++ install requires the c++11 standard. -- UPCXX_NETWORK=smp -- UPCXX_THREADMODE=seq -- UPCXX_CODEMODE=O3 CMake Warning at upcxx-utils/test/CMakeLists.txt:2 (find_package): Found package configuration file:

/opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/share/cmake/UPCXX/UPCXXConfig.cmake

but it set UPCXX_FOUND to FALSE so package "UPCXX" is considered to be NOT FOUND.

-- Installing package version 0.3.0 -- UPCXX_UTILS-utils build type: Release -- added upcxx_utils () -- finding UPCXX for SimCov build -- Found UPCXX: /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/bin/upcxx-meta -- Found UPCXX: /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/bin/upcxx-meta CMake Warning at /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/share/cmake/UPCXX/UPCXXConfig.cmake:129 (message): Compiler compatibility check failed!

UPCXX compiler provided by upcxx-meta CXX:

/opt/intel/compilers_and_libraries_2020.2.254/linux/mpi/intel64/bin/mpicxx -> /opt/intel/compilers_and_libraries_2020.2.254/linux/mpi/intel64/bin/mpicxx

is different from CMAKE_CXX_COMPILER:

/opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++ -> /opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++

Please either pass cmake:

-DCMAKE_CXX_COMPILER=/opt/intel/compilers_and_libraries_2020.2.254/linux/mpi/intel64/bin/mpicxx

or re-install UPC++ with:

CXX=/opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++

Call Stack (most recent call first): src/CMakeLists.txt:5 (find_package)

CMake Error at /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/cmake-3.18.4-2lmiaz6aejwfswraarbhj37mdvspumnw/share/cmake-3.18/Modules/FindPackageHandleStandardArgs.cmake:165 (message): Could NOT find UPCXX (missing: UPCXX_COMPATIBLE_COMPILER) (found version "2020.10.0") Call Stack (most recent call first): /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/cmake-3.18.4-2lmiaz6aejwfswraarbhj37mdvspumnw/share/cmake-3.18/Modules/FindPackageHandleStandardArgs.cmake:458 (_FPHSA_FAILURE_MESSAGE) /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/share/cmake/UPCXX/UPCXXConfig.cmake:269 (find_package_handle_standard_args) src/CMakeLists.txt:5 (find_package)

-- Configuring incomplete, errors occurred! See also "/users/apribis/simcov/.build/CMakeFiles/CMakeOutput.log". See also "/users/apribis/simcov/.build/CMakeFiles/CMakeError.log".

I put the two log files ( /users/apribis/simcov/.build/CMakeFiles/CMakeOutput.log and /users/apribis/simcov/.build/CMakeFiles/CMakeError.log) in this directory: https://drive.google.com/drive/folders/1wVpO435f6r1QnqI-wUUrZ2y0zLsDMbR0?usp=sharing

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/AdaptiveComputationLab/simcov/issues/15, or unsubscribe https://github.com/notifications/unsubscribe-auth/AA2BOCFUUJUFDAOSWL3Z2WLSULQZVANCNFSM4UXUMKBQ .

abbypribis commented 3 years ago

Thanks! So, I ran git submodule init and git submodule update in the simcov directory, and then I tried building again. Here is the result:

[apribis@xena ~]$ cd simcov [apribis@xena simcov]$ git submodule init [apribis@xena simcov]$ git submodule update [apribis@xena simcov]$ module load upcxx/2020.10.0-python3-3o75

The following have been reloaded with a version change: 1) zlib/1.2.11-pkmj => zlib/1.2.11-lfst

[apribis@xena simcov]$ module load cmake/3.18.4-2lmi [apribis@xena simcov]$ ./build.sh Release -- The C compiler identification is GNU 10.2.0 -- The CXX compiler identification is GNU 10.2.0 -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Check for working C compiler: /opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/gcc - skipped -- Detecting C compile features -- Detecting C compile features - done -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Check for working CXX compiler: /opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++ - skipped -- Detecting CXX compile features -- Detecting CXX compile features - done Building Release version -- Submodule update of upcxx-utils -- 37018525d0c4a97650fe01947de1d9fe4dd99499 upcxx-utils (v0.3.0-29-g3701852) matched '^ .* upcxx-utils' -- SIMCOV base version 0.1.1 (0.1.1) -- SIMCOV_BUILD_DATE=20201212_130258 -- No external upcxx-utils package provided -- CMAKE_MODULE_PATH: /users/apribis/simcov/cmake/Modules -- Did not find an installation of upcxx_utils, including submodule in src/upcxx_utils -- Building for Release -- UPCXX_UTILS base version 0.3.0 (0.3.0) -- UPCXX_UTILS_BUILD_DATE=20201212_130258 -- Testing the environment.. -- Found UPCXX: /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/bin/upcxx-meta -- Found UPCXX: /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/bin/upcxx-meta CMake Warning at /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/share/cmake/UPCXX/UPCXXConfig.cmake:129 (message): Compiler compatibility check failed!

UPCXX compiler provided by upcxx-meta CXX:

  /opt/intel/compilers_and_libraries_2020.2.254/linux/mpi/intel64/bin/mpicxx ->
  /opt/intel/compilers_and_libraries_2020.2.254/linux/mpi/intel64/bin/mpicxx

is different from CMAKE_CXX_COMPILER:

  /opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++ ->
  /opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++

Please either pass cmake: -DCMAKE_CXX_COMPILER=/opt/intel/compilers_and_libraries_2020.2.254/linux/mpi/intel64/bin/mpicxx

or re-install UPC++ with: CXX=/opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++

Call Stack (most recent call first): upcxx-utils/CMakeLists.txt:76 (find_package)

-- Could NOT find UPCXX (missing: UPCXX_COMPATIBLE_COMPILER) (found version "2020.10.0") -- This UPC++ install requires the c++11 standard. -- UPCXX_NETWORK=smp -- UPCXX_THREADMODE=seq -- UPCXX_CODEMODE=O3 CMake Warning at upcxx-utils/CMakeLists.txt:76 (find_package): Found package configuration file:

/opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/share/cmake/UPCXX/UPCXXConfig.cmake

but it set UPCXX_FOUND to FALSE so package "UPCXX" is considered to be NOT FOUND.

-- Using UPCXX version - 2020.10.0 20201000 -- Looking for pthread.h -- Looking for pthread.h - found -- Performing Test CMAKE_HAVE_LIBC_PTHREAD -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed -- Looking for pthread_create in pthreads -- Looking for pthread_create in pthreads - not found -- Looking for pthread_create in pthread -- Looking for pthread_create in pthread - found -- Found Threads: TRUE
-- UPCXX_UTILS is using the UPCXX::upcxx library interface: -L/opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/upcxx.opt.gasnet_seq.smp/lib -lupcxx -L/opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/gasnet.opt/lib -lgasnet-smp-seq -lrt -L/opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/lib/gcc/x86_64-pc-linux-gnu/10.2.0 -lgcc -lm -- Found UPCXX: /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/bin/upcxx-meta -- Found UPCXX: /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/bin/upcxx-meta CMake Warning at /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/share/cmake/UPCXX/UPCXXConfig.cmake:129 (message): Compiler compatibility check failed!

UPCXX compiler provided by upcxx-meta CXX:

  /opt/intel/compilers_and_libraries_2020.2.254/linux/mpi/intel64/bin/mpicxx ->
  /opt/intel/compilers_and_libraries_2020.2.254/linux/mpi/intel64/bin/mpicxx

is different from CMAKE_CXX_COMPILER:

  /opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++ ->
  /opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++

Please either pass cmake: -DCMAKE_CXX_COMPILER=/opt/intel/compilers_and_libraries_2020.2.254/linux/mpi/intel64/bin/mpicxx

or re-install UPC++ with: CXX=/opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++

Call Stack (most recent call first): upcxx-utils/test/CMakeLists.txt:2 (find_package)

-- Could NOT find UPCXX (missing: UPCXX_COMPATIBLE_COMPILER) (found version "2020.10.0") -- This UPC++ install requires the c++11 standard. -- UPCXX_NETWORK=smp -- UPCXX_THREADMODE=seq -- UPCXX_CODEMODE=O3 CMake Warning at upcxx-utils/test/CMakeLists.txt:2 (find_package): Found package configuration file:

/opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/share/cmake/UPCXX/UPCXXConfig.cmake

but it set UPCXX_FOUND to FALSE so package "UPCXX" is considered to be NOT FOUND.

-- Installing package version 0.3.0 -- UPCXX_UTILS-utils build type: Release -- added upcxx_utils () -- finding UPCXX for SimCov build -- Found UPCXX: /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/bin/upcxx-meta -- Found UPCXX: /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/bin/upcxx-meta CMake Warning at /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/share/cmake/UPCXX/UPCXXConfig.cmake:129 (message): Compiler compatibility check failed!

UPCXX compiler provided by upcxx-meta CXX:

  /opt/intel/compilers_and_libraries_2020.2.254/linux/mpi/intel64/bin/mpicxx ->
  /opt/intel/compilers_and_libraries_2020.2.254/linux/mpi/intel64/bin/mpicxx

is different from CMAKE_CXX_COMPILER:

  /opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++ ->
  /opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++

Please either pass cmake: -DCMAKE_CXX_COMPILER=/opt/intel/compilers_and_libraries_2020.2.254/linux/mpi/intel64/bin/mpicxx

or re-install UPC++ with: CXX=/opt/spack/opt/spack/linux-centos7-haswell/gcc-4.8.5/gcc-10.2.0-3kjqvw7masskmxqtxblo5khyshwe6zuw/bin/g++

Call Stack (most recent call first): src/CMakeLists.txt:5 (find_package)

CMake Error at /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/cmake-3.18.4-2lmiaz6aejwfswraarbhj37mdvspumnw/share/cmake-3.18/Modules/FindPackageHandleStandardArgs.cmake:165 (message): Could NOT find UPCXX (missing: UPCXX_COMPATIBLE_COMPILER) (found version "2020.10.0") Call Stack (most recent call first): /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/cmake-3.18.4-2lmiaz6aejwfswraarbhj37mdvspumnw/share/cmake-3.18/Modules/FindPackageHandleStandardArgs.cmake:458 (_FPHSA_FAILURE_MESSAGE) /opt/spack/opt/spack/linux-centos7-haswell/gcc-10.2.0/upcxx-2020.10.0-3o75bajpdualqb5h57uhpcsnccnf3bf5/share/cmake/UPCXX/UPCXXConfig.cmake:269 (find_package_handle_standard_args) src/CMakeLists.txt:5 (find_package)

-- Configuring incomplete, errors occurred! See also "/users/apribis/simcov/.build/CMakeFiles/CMakeOutput.log". See also "/users/apribis/simcov/.build/CMakeFiles/CMakeError.log".

Here are the CMakeOutput and CMakeError files: https://drive.google.com/drive/folders/1Z1ZPEIPDPVmTeZY2gRqcAUaOrlS8oMhX?usp=sharing

abbypribis commented 3 years ago

Here is what was inside my upcxx-utils directory, btw (realized I forgot to respond here):

[apribis@xena ~]$ cd simcov [apribis@xena simcov]$ ls batch-scripts CMakeLists.txt install src build.sh covid_default.config README.md upcxx-utils cmake cycells.config scripts VERSION CMakeDefinitions.txt include small-test.config [apribis@xena simcov]$ cd upcxx-utils/ [apribis@xena upcxx-utils]$ ls cmake include LICENSE.txt src VERSION CMakeLists.txt LEGAL.txt README.md test [apribis@xena upcxx-utils]$ cd cmake/ [apribis@xena cmake]$ ls Modules UPCXX_UTILSConfig.cmake [apribis@xena cmake]$ cd Modules/ [apribis@xena Modules]$ ls GetGitVersion.cmake [apribis@xena Modules]$ cd ../.. [apribis@xena upcxx-utils]$ cd include/ [apribis@xena include]$ ls upcxx_utils upcxx_utils.hpp version.h [apribis@xena include]$ cd upcxx_utils [apribis@xena upcxx_utils]$ ls bin_hash.hpp log.hpp timers.hpp colors.h mem_profile.hpp two_tier_aggr_store.hpp flat_aggr_store.hpp progress_bar.hpp version.h heavy_hitter_streaming_store.hpp split_rank.hpp [apribis@xena upcxx_utils]$ cd ../.. [apribis@xena upcxx-utils]$ cd src/ [apribis@xena src]$ ls CMakeLists.txt mem_profile.cpp split_rank.cpp two_tier_aggr_store.cpp log.cpp progress_bar.cpp timers.cpp [apribis@xena src]$ cd .. [apribis@xena upcxx-utils]$ cd test/ [apribis@xena test]$ ls CMakeLists.txt test_progress_bar.cpp test_version.cpp test_aggr_store.cpp test_timers.cpp test_log.cpp test_upcxx_utils.cpp

stevenhofmeyr commented 3 years ago

Hi Abby,

Shall we do a zoom sometitme today to work through this issue?

Steve

On Mon, Dec 14, 2020 at 2:05 PM Abby Pribisova notifications@github.com wrote:

Here is what was inside my upcxx-utils directory, btw (realized I forgot to respond here):

[apribis@xena ~]$ cd simcov [apribis@xena simcov]$ ls batch-scripts CMakeLists.txt install src build.sh covid_default.config README.md upcxx-utils cmake cycells.config scripts VERSION CMakeDefinitions.txt include small-test.config [apribis@xena simcov]$ cd upcxx-utils/ [apribis@xena upcxx-utils]$ ls cmake include LICENSE.txt src VERSION CMakeLists.txt LEGAL.txt README.md test [apribis@xena upcxx-utils]$ cd cmake/ [apribis@xena cmake]$ ls Modules UPCXX_UTILSConfig.cmake [apribis@xena cmake]$ cd Modules/ [apribis@xena Modules]$ ls GetGitVersion.cmake [apribis@xena Modules]$ cd ../.. [apribis@xena upcxx-utils]$ cd include/ [apribis@xena include]$ ls upcxx_utils upcxx_utils.hpp version.h [apribis@xena include]$ cd upcxx_utils [apribis@xena upcxx_utils]$ ls bin_hash.hpp log.hpp timers.hpp colors.h mem_profile.hpp two_tier_aggr_store.hpp flat_aggr_store.hpp progress_bar.hpp version.h heavy_hitter_streaming_store.hpp split_rank.hpp [apribis@xena upcxx_utils]$ cd ../.. [apribis@xena upcxx-utils]$ cd src/ [apribis@xena src]$ ls CMakeLists.txt mem_profile.cpp split_rank.cpp two_tier_aggr_store.cpp log.cpp progress_bar.cpp timers.cpp [apribis@xena src]$ cd .. [apribis@xena upcxx-utils]$ cd test/ [apribis@xena test]$ ls CMakeLists.txt test_progress_bar.cpp test_version.cpp test_aggr_store.cpp test_timers.cpp test_log.cpp test_upcxx_utils.cpp

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/AdaptiveComputationLab/simcov/issues/15#issuecomment-744739725, or unsubscribe https://github.com/notifications/unsubscribe-auth/AA2BOCBQ6D7QJTHVIGJ5J6DSU2D3XANCNFSM4UXUMKBQ .

abbypribis commented 3 years ago

Solution: Modified line in build.sh script:

INSTEAD OF: cmake $rootdir -DCMAKE_BUILD_TYPE=$1 -DCMAKE_INSTALL_PREFIX=$INSTALL_PATH

PUT THIS: cmake $rootdir -DCMAKE_BUILD_TYPE=$1 -DCMAKE_INSTALL_PREFIX=$INSTALL_PATH -DCMAKE_CXX_COMPILER=/opt/intel/compilers_and_libraries_2020.2.254/linux/mpi/intel64/bin/mpicxx