search

parthenon-hpc-lab / parthenon

Parthenon AMR infrastructure
https://parthenon-hpc-lab.github.io/parthenon/
Other
109 stars 33 forks source link

Swarm compiler warning #915

Open pgrete opened 1 year ago

pgrete commented 1 year ago

My compiler (g++ 13.1.1) just started to warm me with

[ 38%] Building CXX object parthenon/src/CMakeFiles/parthenon.dir/interface/swarm.cpp.o
In file included from /usr/include/c++/13.1.1/algorithm:60,
                 from /home/pgrete/src/athenapk/external/parthenon/src/interface/swarm.cpp:13:
In static member function ‘static _Up* std::__copy_move<_IsMove, true, std::random_access_iterator_tag>::__copy_m(_Tp*, _Tp*, _Up*) [with _Tp = long unsigned int; _Up = long unsigned int; bool _IsMove = false]’,
    inlined from ‘_OI std::__copy_move_a2(_II, _II, _OI) [with bool _IsMove = false; _II = long unsigned int*; _OI = long unsigned int*]’ at /usr/include/c++/13.1.1/bits/stl_algobase.h:506:30,
    inlined from ‘_OI std::__copy_move_a1(_II, _II, _OI) [with bool _IsMove = false; _II = long unsigned int*; _OI = long unsigned int*]’ at /usr/include/c++/13.1.1/bits/stl_algobase.h:533:42,
    inlined from ‘_OI std::__copy_move_a(_II, _II, _OI) [with bool _IsMove = false; _II = long unsigned int*; _OI = long unsigned int*]’ at /usr/include/c++/13.1.1/bits/stl_algobase.h:540:31,
    inlined from ‘_OI std::copy(_II, _II, _OI) [with _II = long unsigned int*; _OI = long unsigned int*]’ at /usr/include/c++/13.1.1/bits/stl_algobase.h:633:7,
    inlined from ‘std::vector<bool, _Alloc>::iterator std::vector<bool, _Alloc>::_M_copy_aligned(const_iterator, const_iterator, iterator) [with _Alloc = std::allocator<bool>]’ at /usr/include/c++/13.1.1/bits/stl_bvector.h:1305:28,
    inlined from ‘void std::vector<bool, _Alloc>::_M_fill_insert(iterator, size_type, bool) [with _Alloc = std::allocator<bool>]’ at /usr/include/c++/13.1.1/bits/vector.tcc:879:34,
    inlined from ‘std::vector<bool, _Alloc>::iterator std::vector<bool, _Alloc>::insert(const_iterator, size_type, const bool&) [with _Alloc = std::allocator<bool>]’ at /usr/include/c++/13.1.1/bits/stl_bvector.h:1205:16,
    inlined from ‘void std::vector<bool, _Alloc>::resize(size_type, bool) [with _Alloc = std::allocator<bool>]’ at /usr/include/c++/13.1.1/bits/stl_bvector.h:1251:10,
    inlined from ‘void parthenon::Metadata::DoBit(parthenon::MetadataFlag, bool)’ at /home/pgrete/src/athenapk/external/parthenon/src/interface/metadata.hpp:594:19,
    inlined from ‘void parthenon::Metadata::Set(parthenon::MetadataFlag)’ at /home/pgrete/src/athenapk/external/parthenon/src/interface/metadata.hpp:350:35,
    inlined from ‘void parthenon::Swarm::Add(const std::string&, const parthenon::Metadata&)’ at /home/pgrete/src/athenapk/external/parthenon/src/interface/swarm.cpp:178:11:
/usr/include/c++/13.1.1/bits/stl_algobase.h:437:30: warning: ‘void* __builtin_memmove(void*, const void*, long unsigned int)’ writing between 9 and 9223372036854775807 bytes into a region of size 8 overflows the destination [-Wstringop-overflow=]
  437 |             __builtin_memmove(__result, __first, sizeof(_Tp) * _Num);
      |             ~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
In file included from /usr/include/c++/13.1.1/x86_64-pc-linux-gnu/bits/c++allocator.h:33,
                 from /usr/include/c++/13.1.1/bits/allocator.h:46,
                 from /usr/include/c++/13.1.1/memory:65,
                 from /home/pgrete/src/athenapk/external/parthenon/src/interface/swarm.cpp:16:
In member function ‘_Tp* std::__new_allocator<_Tp>::allocate(size_type, const void*) [with _Tp = long unsigned int]’,
    inlined from ‘static _Tp* std::allocator_traits<std::allocator<_Tp1> >::allocate(allocator_type&, size_type) [with _Tp = long unsigned int]’ at /usr/include/c++/13.1.1/bits/alloc_traits.h:482:28,
    inlined from ‘std::_Bvector_base<_Alloc>::_Bit_pointer std::_Bvector_base<_Alloc>::_M_allocate(std::size_t) [with _Alloc = std::allocator<bool>]’ at /usr/include/c++/13.1.1/bits/stl_bvector.h:643:48,
    inlined from ‘void std::vector<bool, _Alloc>::_M_fill_insert(iterator, size_type, bool) [with _Alloc = std::allocator<bool>]’ at /usr/include/c++/13.1.1/bits/vector.tcc:877:40,
    inlined from ‘std::vector<bool, _Alloc>::iterator std::vector<bool, _Alloc>::insert(const_iterator, size_type, const bool&) [with _Alloc = std::allocator<bool>]’ at /usr/include/c++/13.1.1/bits/stl_bvector.h:1205:16,
    inlined from ‘void std::vector<bool, _Alloc>::resize(size_type, bool) [with _Alloc = std::allocator<bool>]’ at /usr/include/c++/13.1.1/bits/stl_bvector.h:1251:10,
    inlined from ‘void parthenon::Metadata::DoBit(parthenon::MetadataFlag, bool)’ at /home/pgrete/src/athenapk/external/parthenon/src/interface/metadata.hpp:594:19,
    inlined from ‘void parthenon::Metadata::Set(parthenon::MetadataFlag)’ at /home/pgrete/src/athenapk/external/parthenon/src/interface/metadata.hpp:350:35,
    inlined from ‘void parthenon::Swarm::Add(const std::string&, const parthenon::Metadata&)’ at /home/pgrete/src/athenapk/external/parthenon/src/interface/swarm.cpp:178:11:
/usr/include/c++/13.1.1/bits/new_allocator.h:147:55: note: destination object of size 8 allocated by ‘operator new’
  147 |         return static_cast<_Tp*>(_GLIBCXX_OPERATOR_NEW(__n * sizeof(_Tp)));
      |

I'm not sure I can fully make sense of that warning. Have you seen this @brryan ?

brryan commented 1 year ago

@pgrete Thanks for pinging me,I haven't seen this error, including just now when I tried with g++ 12.1.0 with the following configure statement 

cmake -DREGRESSION_GOLD_STANDARD_SYNC=OFF -DCMAKE_BUILD_TYPE=Debug -DENABLE_COMPILER_WARNINGS=ON -DKokkos_ENABLE_CUDA=ON ~/github/parthenon

Do you suspect it could be related to g++ 13+? Our testbed system is down today so I don't have immediate access to that compiler, but hopefully I can try to reproduce with that compiler version ~tomorrow

pgrete commented 1 year ago

I did some further testing and it seems to show up for a Release build only. Here's a full log of a vanilla build of current develop:

$ cmake -Bbuild-vanilla -DCMAKE_BUILD_TYPE=Release
CMake Warning at cmake/MachineCfg.cmake:61 (message):
  Not using any machine configuration.  Consider creating a configuration
  file following the examples in /cmake/machine_cfgs/ and then point the
  MACHINE_CFG cmake or environment variable to your custom file.Note, that
  the machine file can be placed in any directory (also outside the repo).
Call Stack (most recent call first):
  CMakeLists.txt:21 (include)

-- The C compiler identification is GNU 13.1.1
-- The CXX compiler identification is GNU 13.1.1
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: /usr/bin/cc - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/c++ - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- clang-format --version: 15.0.7
-- black --version: black, 23.7.0 (compiled: no)
Python (CPython) 3.11.3

-- Looking for C++ include filesystem
-- Looking for C++ include filesystem - found
-- Performing Test CXX_FILESYSTEM_NO_LINK_NEEDED
-- Performing Test CXX_FILESYSTEM_NO_LINK_NEEDED - Success
-- Found MPI_CXX: /usr/lib/libmpi_cxx.so (found version "3.1") 
-- Found MPI: TRUE (found version "3.1") found components: CXX 
-- Found HDF5: /usr/lib/libhdf5.so;/usr/lib/libsz.so;/usr/lib/libz.so;/usr/lib/libdl.a;/usr/lib/libm.so (found version "1.14.1-2") found components: C 
-- Setting default Kokkos CXX standard to 17
-- The project name is: Kokkos
-- Using internal gtest for testing
-- Configured git information in /home/pgrete/src/parthenon/build-vanilla/generated/Kokkos_Version_Info.cpp
-- SERIAL backend is being turned on to ensure there is at least one Host space. To change this, you must enable another host execution space and configure with -DKokkos_ENABLE_SERIAL=OFF or change CMakeCache.txt
-- Using -std=c++17 for C++17 standard as feature
-- Built-in Execution Spaces:
--     Device Parallel: NoTypeDefined
--     Host Parallel: NoTypeDefined
--       Host Serial: SERIAL
-- 
-- Architectures:
-- Found TPLLIBDL: /usr/include  
-- Using internal desul_atomics copy
-- Kokkos Devices: SERIAL, Kokkos Backends: SERIAL
-- Using Kokkos source from Parthenon submodule at /home/pgrete/src/parthenon/external/Kokkos
-- Gold standard is up-to-date (version 19). No download required.
-- Building unit tests.
-- Found Python3: /usr/bin/python3.11 (found version "3.11.3") found components: Interpreter 
-- Building integration tests.
-- Building performance tests.
-- Building regression tests.
-- PAR_LOOP_LAYOUT='SIMDFOR_LOOP' (default par_for wrapper layout)
-- PAR_LOOP_INNER_LAYOUT='SIMDFOR_INNER_LOOP' (default par_for_inner wrapper layout)
-- Found Git: /usr/bin/git (found version "2.41.0") 
-- Configuring done (4.6s)
-- Generating done (0.0s)
-- Build files have been written to: /home/pgrete/src/parthenon/build-vanilla
[17:36:43][pgrete@haerke: ~/src/parthenon]
$ cmake --build build-vanilla -j1
-- Configured git information in /home/pgrete/src/parthenon/build-vanilla/Kokkos/generated/Kokkos_Version_Info.cpp
[  0%] Built target AlwaysCheckGit
[  0%] Building CXX object Kokkos/CMakeFiles/impl_git_version.dir/__/generated/Kokkos_Version_Info.cpp.o
[  0%] Linking CXX static library libimpl_git_version.a
[  0%] Built target impl_git_version
[  0%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_CPUDiscovery.cpp.o
[  4%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_Command_Line_Parsing.cpp.o
[  4%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_Core.cpp.o
[  4%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_Error.cpp.o
[  4%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_ExecPolicy.cpp.o
[  4%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_HostBarrier.cpp.o
[  4%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_HostSpace.cpp.o
[  4%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_HostSpace_deepcopy.cpp.o
[  8%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_HostThreadTeam.cpp.o
[  8%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_MemoryPool.cpp.o
[  8%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_MemorySpace.cpp.o
[  8%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_Profiling.cpp.o
[  8%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_SharedAlloc.cpp.o
[  8%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_Spinwait.cpp.o
[ 12%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_Stacktrace.cpp.o
[ 12%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_hwloc.cpp.o
[ 12%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/Serial/Kokkos_Serial.cpp.o
[ 12%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/Serial/Kokkos_Serial_Task.cpp.o
[ 12%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/__/__/tpls/desul/src/Lock_Array_CUDA.cpp.o
[ 12%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/__/__/tpls/desul/src/Lock_Array_HIP.cpp.o
[ 16%] Linking CXX static library libkokkoscore.a
[ 16%] Built target kokkoscore
[ 16%] Building CXX object Kokkos/containers/src/CMakeFiles/kokkoscontainers.dir/impl/Kokkos_UnorderedMap_impl.cpp.o
[ 16%] Linking CXX static library libkokkoscontainers.a
[ 16%] Built target kokkoscontainers
[ 16%] Building CXX object Kokkos/simd/src/CMakeFiles/kokkossimd.dir/Kokkos_SIMD_dummy.cpp.o
[ 16%] Linking CXX static library libkokkossimd.a
[ 16%] Built target kokkossimd
[ 20%] Building CXX object tst/CMakeFiles/catch2_define.dir/catch2_define.cpp.o
[ 20%] Linking CXX static library libcatch2_define.a
[ 20%] Built target catch2_define
[ 20%] Building CXX object src/CMakeFiles/parthenon.dir/bvals/comms/build_boundary_buffers.cpp.o
[ 20%] Building CXX object src/CMakeFiles/parthenon.dir/bvals/comms/bnd_info.cpp.o
[ 20%] Building CXX object src/CMakeFiles/parthenon.dir/bvals/comms/boundary_communication.cpp.o
[ 24%] Building CXX object src/CMakeFiles/parthenon.dir/bvals/comms/flux_correction.cpp.o
[ 24%] Building CXX object src/CMakeFiles/parthenon.dir/bvals/comms/tag_map.cpp.o
[ 24%] Building CXX object src/CMakeFiles/parthenon.dir/bvals/boundary_conditions.cpp.o
[ 24%] Building CXX object src/CMakeFiles/parthenon.dir/bvals/bvals.cpp.o
[ 24%] Building CXX object src/CMakeFiles/parthenon.dir/bvals/bvals_base.cpp.o
[ 24%] Building CXX object src/CMakeFiles/parthenon.dir/bvals/boundary_flag.cpp.o
[ 24%] Building CXX object src/CMakeFiles/parthenon.dir/bvals/bvals_var.cpp.o
[ 28%] Building CXX object src/CMakeFiles/parthenon.dir/bvals/bvals_swarm.cpp.o
[ 28%] Building CXX object src/CMakeFiles/parthenon.dir/driver/driver.cpp.o
[ 28%] Building CXX object src/CMakeFiles/parthenon.dir/driver/multistage.cpp.o
[ 28%] Building CXX object src/CMakeFiles/parthenon.dir/interface/data_collection.cpp.o
[ 28%] Building CXX object src/CMakeFiles/parthenon.dir/interface/meshblock_data.cpp.o
[ 28%] Building CXX object src/CMakeFiles/parthenon.dir/interface/swarm_container.cpp.o
[ 32%] Building CXX object src/CMakeFiles/parthenon.dir/interface/swarm.cpp.o
In file included from /usr/include/c++/13.1.1/algorithm:60,
                 from /home/pgrete/src/parthenon/src/interface/swarm.cpp:13:
In static member function ‘static _Up* std::__copy_move<_IsMove, true, std::random_access_iterator_tag>::__copy_m(_Tp*, _Tp*, _Up*) [with _Tp = long unsigned int; _Up = long unsigned int; bool _IsMove = false]’,
    inlined from ‘_OI std::__copy_move_a2(_II, _II, _OI) [with bool _IsMove = false; _II = long unsigned int*; _OI = long unsigned int*]’ at /usr/include/c++/13.1.1/bits/stl_algobase.h:506:30,
    inlined from ‘_OI std::__copy_move_a1(_II, _II, _OI) [with bool _IsMove = false; _II = long unsigned int*; _OI = long unsigned int*]’ at /usr/include/c++/13.1.1/bits/stl_algobase.h:533:42,
    inlined from ‘_OI std::__copy_move_a(_II, _II, _OI) [with bool _IsMove = false; _II = long unsigned int*; _OI = long unsigned int*]’ at /usr/include/c++/13.1.1/bits/stl_algobase.h:540:31,
    inlined from ‘_OI std::copy(_II, _II, _OI) [with _II = long unsigned int*; _OI = long unsigned int*]’ at /usr/include/c++/13.1.1/bits/stl_algobase.h:633:7,
    inlined from ‘std::vector<bool, _Alloc>::iterator std::vector<bool, _Alloc>::_M_copy_aligned(const_iterator, const_iterator, iterator) [with _Alloc = std::allocator<bool>]’ at /usr/include/c++/13.1.1/bits/stl_bvector.h:1305:28,
    inlined from ‘void std::vector<bool, _Alloc>::_M_fill_insert(iterator, size_type, bool) [with _Alloc = std::allocator<bool>]’ at /usr/include/c++/13.1.1/bits/vector.tcc:879:34,
    inlined from ‘std::vector<bool, _Alloc>::iterator std::vector<bool, _Alloc>::insert(const_iterator, size_type, const bool&) [with _Alloc = std::allocator<bool>]’ at /usr/include/c++/13.1.1/bits/stl_bvector.h:1205:16,
    inlined from ‘void std::vector<bool, _Alloc>::resize(size_type, bool) [with _Alloc = std::allocator<bool>]’ at /usr/include/c++/13.1.1/bits/stl_bvector.h:1251:10,
    inlined from ‘void parthenon::Metadata::DoBit(parthenon::MetadataFlag, bool)’ at /home/pgrete/src/parthenon/src/interface/metadata.hpp:594:19,
    inlined from ‘void parthenon::Metadata::Set(parthenon::MetadataFlag)’ at /home/pgrete/src/parthenon/src/interface/metadata.hpp:350:35,
    inlined from ‘void parthenon::Swarm::Add(const std::string&, const parthenon::Metadata&)’ at /home/pgrete/src/parthenon/src/interface/swarm.cpp:178:11:
/usr/include/c++/13.1.1/bits/stl_algobase.h:437:30: warning: ‘void* __builtin_memmove(void*, const void*, long unsigned int)’ writing between 9 and 9223372036854775807 bytes into a region of size 8 overflows the destination [-Wstringop-overflow=]
  437 |             __builtin_memmove(__result, __first, sizeof(_Tp) * _Num);
      |             ~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
In file included from /usr/include/c++/13.1.1/x86_64-pc-linux-gnu/bits/c++allocator.h:33,
                 from /usr/include/c++/13.1.1/bits/allocator.h:46,
                 from /usr/include/c++/13.1.1/memory:65,
                 from /home/pgrete/src/parthenon/src/interface/swarm.cpp:16:
In member function ‘_Tp* std::__new_allocator<_Tp>::allocate(size_type, const void*) [with _Tp = long unsigned int]’,
    inlined from ‘static _Tp* std::allocator_traits<std::allocator<_Tp1> >::allocate(allocator_type&, size_type) [with _Tp = long unsigned int]’ at /usr/include/c++/13.1.1/bits/alloc_traits.h:482:28,
    inlined from ‘std::_Bvector_base<_Alloc>::_Bit_pointer std::_Bvector_base<_Alloc>::_M_allocate(std::size_t) [with _Alloc = std::allocator<bool>]’ at /usr/include/c++/13.1.1/bits/stl_bvector.h:643:48,
    inlined from ‘void std::vector<bool, _Alloc>::_M_fill_insert(iterator, size_type, bool) [with _Alloc = std::allocator<bool>]’ at /usr/include/c++/13.1.1/bits/vector.tcc:877:40,
    inlined from ‘std::vector<bool, _Alloc>::iterator std::vector<bool, _Alloc>::insert(const_iterator, size_type, const bool&) [with _Alloc = std::allocator<bool>]’ at /usr/include/c++/13.1.1/bits/stl_bvector.h:1205:16,
    inlined from ‘void std::vector<bool, _Alloc>::resize(size_type, bool) [with _Alloc = std::allocator<bool>]’ at /usr/include/c++/13.1.1/bits/stl_bvector.h:1251:10,
    inlined from ‘void parthenon::Metadata::DoBit(parthenon::MetadataFlag, bool)’ at /home/pgrete/src/parthenon/src/interface/metadata.hpp:594:19,
    inlined from ‘void parthenon::Metadata::Set(parthenon::MetadataFlag)’ at /home/pgrete/src/parthenon/src/interface/metadata.hpp:350:35,
    inlined from ‘void parthenon::Swarm::Add(const std::string&, const parthenon::Metadata&)’ at /home/pgrete/src/parthenon/src/interface/swarm.cpp:178:11:
/usr/include/c++/13.1.1/bits/new_allocator.h:147:55: note: destination object of size 8 allocated by ‘operator new’
  147 |         return static_cast<_Tp*>(_GLIBCXX_OPERATOR_NEW(__n * sizeof(_Tp)));
      |                                                       ^
[ 32%] Building CXX object src/CMakeFiles/parthenon.dir/interface/metadata.cpp.o
...
brryan commented 1 year ago

Thanks for the log @pgrete. At the moment I can't reproduce with gcc 13.1.0. The line called out by the warning seems pretty innocuous, just newm.Set(Metadata::Particle);. I'll see if I can't get gcc 13.1.1 running and hopefully reproduce. 

(py3_p9) [brryan@cn2022 testbuild]$ module list
Currently Loaded Modulefiles:
  1) miniconda/miniconda3           2) cmake/3.17.3                   3) gcc/13.1.0                     4) openmpi/5.0.0rc11-gcc_13.1.0
(py3_p9) [brryan@cn2022 testbuild]$ cmake -DCMAKE_BUILD_TYPE=Release -DPARTHENON_DISABLE_HDF5=ON ../../../github/parthenon/
CMake Warning at cmake/MachineCfg.cmake:61 (message):
  Not using any machine configuration.  Consider creating a configuration
  file following the examples in /cmake/machine_cfgs/ and then point the
  MACHINE_CFG cmake or environment variable to your custom file.Note, that
  the machine file can be placed in any directory (also outside the repo).
Call Stack (most recent call first):
  CMakeLists.txt:21 (include)

-- The C compiler identification is GNU 13.1.0
-- The CXX compiler identification is GNU 13.1.0
-- Check for working C compiler: /projects/opt/rhel7/ppc64le/gcc/13.1.0/bin/gcc
-- Check for working C compiler: /projects/opt/rhel7/ppc64le/gcc/13.1.0/bin/gcc - works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /projects/opt/rhel7/ppc64le/gcc/13.1.0/bin/g++
-- Check for working CXX compiler: /projects/opt/rhel7/ppc64le/gcc/13.1.0/bin/g++ - works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
CMake Warning at cmake/Format.cmake:53 (message):
  Couldn't determine clang-format version.  clang-format >=11.0 is required -
  results on previous versions may not be stable
Call Stack (most recent call first):
  CMakeLists.txt:61 (include)

-- Looking for C++ include filesystem
-- Looking for C++ include filesystem - found
-- Performing Test CXX_FILESYSTEM_NO_LINK_NEEDED
-- Performing Test CXX_FILESYSTEM_NO_LINK_NEEDED - Success
-- Found MPI_CXX: /projects/opt/rhel7/ppc64le/p9/openmpi/5.0.0rc11-gcc_13.1.0/lib/libmpi.so (found version "3.1") 
-- Found MPI: TRUE (found version "3.1") found components: CXX 
-- Setting default Kokkos CXX standard to 17
-- The project name is: Kokkos
-- Using internal gtest for testing
-- Configured git information in /vast/home/brryan/builds/parthenon/testbuild/generated/Kokkos_Version_Info.cpp
-- SERIAL backend is being turned on to ensure there is at least one Host space. To change this, you must enable another host execution space and configure with -DKokkos_ENABLE_SERIAL=OFF or change CMakeCache.txt
-- Using -std=c++17 for C++17 standard as feature
-- Built-in Execution Spaces:
--     Device Parallel: NoTypeDefined
--     Host Parallel: NoTypeDefined
--       Host Serial: SERIAL
-- 
-- Architectures:
-- Found TPLLIBDL: /usr/include  
-- Using internal desul_atomics copy
-- Kokkos Devices: SERIAL, Kokkos Backends: SERIAL
-- Using Kokkos source from Parthenon submodule at /vast/home/brryan/github/parthenon/external/Kokkos
-- Gold standard is up-to-date (version 19). No download required.
-- Building unit tests.
-- Found Python3: /vast/home/brryan/.conda/envs/py3_p9/bin/python3.9 (found version "3.9.7") found components: Interpreter 
-- Building integration tests.
-- Building performance tests.
-- Building regression tests.
-- PAR_LOOP_LAYOUT='SIMDFOR_LOOP' (default par_for wrapper layout)
-- PAR_LOOP_INNER_LAYOUT='SIMDFOR_INNER_LOOP' (default par_for_inner wrapper layout)
-- Found Git: /usr/bin/git (found version "1.8.3.1") 
fatal: Not a git repository (or any parent up to mount point /vast/home)
Stopping at filesystem boundary (GIT_DISCOVERY_ACROSS_FILESYSTEM not set).
-- Configuring done
-- Generating done
-- Build files have been written to: /vast/home/brryan/builds/parthenon/testbuild
(py3_p9) [brryan@cn2022 testbuild]$ make -j
Scanning dependencies of target AlwaysCheckGit
Scanning dependencies of target kokkossimd
Scanning dependencies of target kokkoscore
[  2%] Building CXX object Kokkos/simd/src/CMakeFiles/kokkossimd.dir/Kokkos_SIMD_dummy.cpp.o
[  2%] Linking CXX static library libkokkossimd.a
[  2%] Built target kokkossimd
[  2%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_CPUDiscovery.cpp.o
[  2%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_Command_Line_Parsing.cpp.o
[  5%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_Error.cpp.o
[  5%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_ExecPolicy.cpp.o
[  5%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_Core.cpp.o
[  5%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_HostBarrier.cpp.o
[  7%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_HostSpace_deepcopy.cpp.o
[  7%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_HostSpace.cpp.o
[  7%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_HostThreadTeam.cpp.o
[  7%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_MemoryPool.cpp.o
[ 10%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_Profiling.cpp.o
[ 10%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_MemorySpace.cpp.o
[ 10%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_SharedAlloc.cpp.o
[ 10%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_Spinwait.cpp.o
[ 12%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_Stacktrace.cpp.o
[ 12%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_hwloc.cpp.o
[ 12%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/Serial/Kokkos_Serial.cpp.o
[ 15%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/__/__/tpls/desul/src/Lock_Array_CUDA.cpp.o
[ 15%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/Serial/Kokkos_Serial_Task.cpp.o
[ 15%] Building CXX object Kokkos/core/src/CMakeFiles/kokkoscore.dir/__/__/tpls/desul/src/Lock_Array_HIP.cpp.o
-- Configured git information in /vast/home/brryan/builds/parthenon/testbuild/Kokkos/generated/Kokkos_Version_Info.cpp
[ 15%] Built target AlwaysCheckGit
Scanning dependencies of target impl_git_version
[ 15%] Building CXX object Kokkos/CMakeFiles/impl_git_version.dir/__/generated/Kokkos_Version_Info.cpp.o
[ 15%] Linking CXX static library libimpl_git_version.a
[ 15%] Built target impl_git_version
[ 15%] Linking CXX static library libkokkoscore.a
[ 15%] Built target kokkoscore
Scanning dependencies of target kokkoscontainers
[ 17%] Building CXX object Kokkos/containers/src/CMakeFiles/kokkoscontainers.dir/impl/Kokkos_UnorderedMap_impl.cpp.o
[ 17%] Linking CXX static library libkokkoscontainers.a
[ 17%] Built target kokkoscontainers
Scanning dependencies of target catch2_define
Scanning dependencies of target parthenon
[ 17%] Building CXX object tst/CMakeFiles/catch2_define.dir/catch2_define.cpp.o
[ 20%] Building CXX object src/CMakeFiles/parthenon.dir/bvals/comms/bnd_info.cpp.o
[ 20%] Building CXX object src/CMakeFiles/parthenon.dir/bvals/comms/build_boundary_buffers.cpp.o
[ 20%] Building CXX object src/CMakeFiles/parthenon.dir/bvals/comms/tag_map.cpp.o
[ 23%] Building CXX object src/CMakeFiles/parthenon.dir/bvals/comms/flux_correction.cpp.o
[ 23%] Building CXX object src/CMakeFiles/parthenon.dir/bvals/boundary_conditions.cpp.o
[ 25%] Building CXX object src/CMakeFiles/parthenon.dir/bvals/bvals_base.cpp.o
[ 25%] Building CXX object src/CMakeFiles/parthenon.dir/driver/multistage.cpp.o
[ 25%] Building CXX object src/CMakeFiles/parthenon.dir/driver/driver.cpp.o
[ 25%] Building CXX object src/CMakeFiles/parthenon.dir/bvals/bvals_swarm.cpp.o
[ 25%] Building CXX object src/CMakeFiles/parthenon.dir/bvals/comms/boundary_communication.cpp.o
[ 25%] Building CXX object src/CMakeFiles/parthenon.dir/bvals/boundary_flag.cpp.o
[ 28%] Building CXX object src/CMakeFiles/parthenon.dir/interface/meshblock_data.cpp.o
[ 28%] Building CXX object src/CMakeFiles/parthenon.dir/interface/swarm_container.cpp.o
[ 33%] Building CXX object src/CMakeFiles/parthenon.dir/interface/update.cpp.o
[ 30%] Building CXX object src/CMakeFiles/parthenon.dir/interface/swarm.cpp.o
[ 30%] Building CXX object src/CMakeFiles/parthenon.dir/bvals/bvals.cpp.o
[ 33%] Building CXX object src/CMakeFiles/parthenon.dir/interface/variable_state.cpp.o
[ 33%] Building CXX object src/CMakeFiles/parthenon.dir/interface/sparse_pack_base.cpp.o
[ 33%] Building CXX object src/CMakeFiles/parthenon.dir/bvals/bvals_var.cpp.o
[ 33%] Building CXX object src/CMakeFiles/parthenon.dir/interface/params.cpp.o
[ 33%] Building CXX object src/CMakeFiles/parthenon.dir/interface/sparse_pool.cpp.o
[ 35%] Building CXX object src/CMakeFiles/parthenon.dir/mesh/meshblock.cpp.o
[ 35%] Building CXX object src/CMakeFiles/parthenon.dir/interface/data_collection.cpp.o
[ 35%] Building CXX object src/CMakeFiles/parthenon.dir/mesh/mesh_refinement.cpp.o
[ 38%] Building CXX object src/CMakeFiles/parthenon.dir/outputs/ascent.cpp.o
[ 35%] Building CXX object src/CMakeFiles/parthenon.dir/mesh/mesh.cpp.o
[ 35%] Building CXX object src/CMakeFiles/parthenon.dir/mesh/amr_loadbalance.cpp.o
[ 38%] Building CXX object src/CMakeFiles/parthenon.dir/outputs/history.cpp.o
[ 38%] Building CXX object src/CMakeFiles/parthenon.dir/interface/metadata.cpp.o
[ 38%] Building CXX object src/CMakeFiles/parthenon.dir/interface/state_descriptor.cpp.o
[ 41%] Building CXX object src/CMakeFiles/parthenon.dir/outputs/parthenon_hdf5.cpp.o
[ 41%] Building CXX object src/CMakeFiles/parthenon.dir/outputs/outputs.cpp.o
[ 41%] Building CXX object src/CMakeFiles/parthenon.dir/mesh/meshblock_tree.cpp.o
[ 43%] Building CXX object src/CMakeFiles/parthenon.dir/outputs/io_wrapper.cpp.o
[ 41%] Building CXX object src/CMakeFiles/parthenon.dir/outputs/output_utils.cpp.o
[ 41%] Building CXX object src/CMakeFiles/parthenon.dir/interface/variable.cpp.o
[ 43%] Building CXX object src/CMakeFiles/parthenon.dir/outputs/parthenon_xdmf.cpp.o
[ 43%] Building CXX object src/CMakeFiles/parthenon.dir/outputs/restart.cpp.o
[ 43%] Building CXX object src/CMakeFiles/parthenon.dir/outputs/vtk.cpp.o
[ 43%] Building CXX object src/CMakeFiles/parthenon.dir/pgen/default_pgen.cpp.o
[ 46%] Building CXX object src/CMakeFiles/parthenon.dir/amr_criteria/refinement_package.cpp.o
[ 51%] Building CXX object src/CMakeFiles/parthenon.dir/time_integration/low_storage_integrator.cpp.o
[ 51%] Building CXX object src/CMakeFiles/parthenon.dir/prolong_restrict/prolong_restrict.cpp.o
[ 51%] Building CXX object src/CMakeFiles/parthenon.dir/time_integration/butcher_integrator.cpp.o
[ 51%] Building CXX object src/CMakeFiles/parthenon.dir/time_integration/staged_integrator.cpp.o
[ 51%] Building CXX object src/CMakeFiles/parthenon.dir/utils/buffer_utils.cpp.o
[ 51%] Building CXX object src/CMakeFiles/parthenon.dir/utils/alias_method.cpp.o
[ 51%] Building CXX object src/CMakeFiles/parthenon.dir/tasks/task_id.cpp.o
[ 46%] Building CXX object src/CMakeFiles/parthenon.dir/amr_criteria/amr_criteria.cpp.o
[ 53%] Building CXX object src/CMakeFiles/parthenon.dir/utils/show_config.cpp.o
[ 53%] Building CXX object src/CMakeFiles/parthenon.dir/utils/change_rundir.cpp.o
[ 53%] Building CXX object src/CMakeFiles/parthenon.dir/utils/error_checking.cpp.o
[ 53%] Building CXX object src/CMakeFiles/parthenon.dir/utils/signal_handler.cpp.o
[ 53%] Building CXX object src/CMakeFiles/parthenon.dir/utils/unique_id.cpp.o
[ 53%] Building CXX object src/CMakeFiles/parthenon.dir/utils/string_utils.cpp.o
[ 56%] Building CXX object src/CMakeFiles/parthenon.dir/globals.cpp.o
[ 56%] Building CXX object src/CMakeFiles/parthenon.dir/parameter_input.cpp.o
[ 56%] Building CXX object src/CMakeFiles/parthenon.dir/parthenon_manager.cpp.o
In file included from /vast/home/brryan/github/parthenon/tst/catch2_define.cpp:21:
/vast/home/brryan/github/parthenon/external/Catch2/single_include/catch2/catch.hpp: In instantiation of ‘Catch::Benchmark::Estimate<double> Catch::Benchmark::Detail::bootstrap(double, Iterator, Iterator, const sample&, Estimator&&) [with Iterator = __gnu_cxx::__normal_iterator<double*, std::vector<double> >; Estimator = double (*&)(__gnu_cxx::__normal_iterator<double*, std::vector<double> >, __gnu_cxx::__normal_iterator<double*, std::vector<double> >); sample = std::vector<double>]’:
/vast/home/brryan/github/parthenon/external/Catch2/single_include/catch2/catch.hpp:7843:37:   required from here
/vast/home/brryan/github/parthenon/external/Catch2/single_include/catch2/catch.hpp:7048:118: note: parameter passing for argument of type ‘std::pair<double, double>’ when C++17 is enabled changed to match C++14 in GCC 10.1
 7048 |                 std::tie(sum_squares, sum_cubes) = std::accumulate(jack.begin(), jack.end(), std::make_pair(0., 0.), [jack_mean](std::pair<double, double> sqcb, double x) -> std::pair<double, double> {
      |                                                                                                                      ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
 7049 |                     auto d = jack_mean - x;
      |                     ~~~~~~~~~~~~~~~~~~~~~~~                                                                           
 7050 |                     auto d2 = d * d;
      |                     ~~~~~~~~~~~~~~~~                                                                                  
 7051 |                     auto d3 = d2 * d;
      |                     ~~~~~~~~~~~~~~~~~                                                                                 
 7052 |                     return { sqcb.first + d2, sqcb.second + d3 };
      |                     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~                                                     
 7053 |                 });
      |                 ~                                                                                                     
[ 58%] Linking CXX static library libparthenon.a
[ 58%] Built target parthenon
Scanning dependencies of target advection-example
Scanning dependencies of target stochastic_subgrid-example
Scanning dependencies of target pi-example
Scanning dependencies of target kokkos_pi
Scanning dependencies of target particles-example
Scanning dependencies of target particle-leapfrog
Scanning dependencies of target poisson-example
Scanning dependencies of target particle-tracers
Scanning dependencies of target burgers-benchmark
Scanning dependencies of target sparse_advection-example
[ 58%] Building CXX object example/kokkos_pi/CMakeFiles/kokkos_pi.dir/kokkos_pi.cpp.o
[ 61%] Building CXX object example/calculate_pi/CMakeFiles/pi-example.dir/calculate_pi.cpp.o
[ 61%] Building CXX object example/calculate_pi/CMakeFiles/pi-example.dir/pi_driver.cpp.o
[ 61%] Building CXX object example/particle_tracers/CMakeFiles/particle-tracers.dir/particle_tracers.cpp.o
[ 61%] Building CXX object example/particle_leapfrog/CMakeFiles/particle-leapfrog.dir/particle_leapfrog.cpp.o
[ 61%] Building CXX object example/particle_tracers/CMakeFiles/particle-tracers.dir/main.cpp.o
[ 61%] Building CXX object example/particle_leapfrog/CMakeFiles/particle-leapfrog.dir/main.cpp.o
[ 61%] Building CXX object example/particles/CMakeFiles/particles-example.dir/main.cpp.o
[ 64%] Building CXX object example/particles/CMakeFiles/particles-example.dir/particles.cpp.o
[ 64%] Building CXX object example/poisson/CMakeFiles/poisson-example.dir/poisson_driver.cpp.o
[ 64%] Building CXX object example/poisson/CMakeFiles/poisson-example.dir/poisson_package.cpp.o
[ 64%] Building CXX object example/sparse_advection/CMakeFiles/sparse_advection-example.dir/sparse_advection_driver.cpp.o
[ 69%] Building CXX object example/poisson/CMakeFiles/poisson-example.dir/main.cpp.o
[ 69%] Building CXX object benchmarks/burgers/CMakeFiles/burgers-benchmark.dir/burgers_driver.cpp.o
[ 69%] Building CXX object example/advection/CMakeFiles/advection-example.dir/advection_driver.cpp.o
[ 69%] Building CXX object example/sparse_advection/CMakeFiles/sparse_advection-example.dir/parthenon_app_inputs.cpp.o
[ 66%] Building CXX object example/poisson/CMakeFiles/poisson-example.dir/parthenon_app_inputs.cpp.o
[ 66%] Building CXX object example/sparse_advection/CMakeFiles/sparse_advection-example.dir/sparse_advection_package.cpp.o
[ 69%] Building CXX object example/sparse_advection/CMakeFiles/sparse_advection-example.dir/main.cpp.o
[ 69%] Building CXX object example/advection/CMakeFiles/advection-example.dir/main.cpp.o
[ 69%] Building CXX object benchmarks/burgers/CMakeFiles/burgers-benchmark.dir/burgers_package.cpp.o
[ 69%] Building CXX object example/advection/CMakeFiles/advection-example.dir/advection_package.cpp.o
[ 71%] Building CXX object benchmarks/burgers/CMakeFiles/burgers-benchmark.dir/main.cpp.o
[ 74%] Building CXX object example/advection/CMakeFiles/advection-example.dir/parthenon_app_inputs.cpp.o
[ 74%] Building CXX object benchmarks/burgers/CMakeFiles/burgers-benchmark.dir/parthenon_app_inputs.cpp.o
[ 74%] Building CXX object example/stochastic_subgrid/CMakeFiles/stochastic_subgrid-example.dir/stochastic_subgrid_driver.cpp.o
[ 76%] Building CXX object example/stochastic_subgrid/CMakeFiles/stochastic_subgrid-example.dir/stochastic_subgrid_package.cpp.o
[ 76%] Building CXX object example/stochastic_subgrid/CMakeFiles/stochastic_subgrid-example.dir/parthenon_app_inputs.cpp.o
[ 76%] Building CXX object example/stochastic_subgrid/CMakeFiles/stochastic_subgrid-example.dir/main.cpp.o
[ 79%] Linking CXX static library libcatch2_define.a
[ 79%] Built target catch2_define
Scanning dependencies of target performance_tests
Scanning dependencies of target unit_tests
[ 79%] Building CXX object tst/performance/CMakeFiles/performance_tests.dir/test_meshblock_data_iterator.cpp.o
[ 82%] Building CXX object tst/unit/CMakeFiles/unit_tests.dir/test_concepts_lite.cpp.o
[ 82%] Building CXX object tst/unit/CMakeFiles/unit_tests.dir/test_tasklist.cpp.o
[ 82%] Building CXX object tst/unit/CMakeFiles/unit_tests.dir/test_taskid.cpp.o
[ 82%] Building CXX object tst/unit/CMakeFiles/unit_tests.dir/test_data_collection.cpp.o
[ 84%] Building CXX object tst/unit/CMakeFiles/unit_tests.dir/test_unit_params.cpp.o
[ 84%] Building CXX object tst/unit/CMakeFiles/unit_tests.dir/test_unit_domain.cpp.o
[ 84%] Building CXX object tst/unit/CMakeFiles/unit_tests.dir/test_unit_constants.cpp.o
[ 84%] Building CXX object tst/unit/CMakeFiles/unit_tests.dir/test_unit_sort.cpp.o
[ 87%] Building CXX object tst/unit/CMakeFiles/unit_tests.dir/kokkos_abstraction.cpp.o
[ 87%] Building CXX object tst/unit/CMakeFiles/unit_tests.dir/test_logical_location.cpp.o
[ 87%] Building CXX object tst/unit/CMakeFiles/unit_tests.dir/test_metadata.cpp.o
[ 87%] Building CXX object tst/unit/CMakeFiles/unit_tests.dir/test_pararrays.cpp.o
[ 89%] Building CXX object tst/unit/CMakeFiles/unit_tests.dir/test_mesh_data.cpp.o
[ 89%] Building CXX object tst/unit/CMakeFiles/unit_tests.dir/test_nan_tags.cpp.o
[ 89%] Building CXX object tst/unit/CMakeFiles/unit_tests.dir/test_meshblock_data_iterator.cpp.o
[ 92%] Building CXX object tst/unit/CMakeFiles/unit_tests.dir/test_sparse_pack.cpp.o
[ 92%] Building CXX object tst/unit/CMakeFiles/unit_tests.dir/test_swarm.cpp.o
[ 92%] Building CXX object tst/unit/CMakeFiles/unit_tests.dir/test_required_desired.cpp.o
[ 92%] Building CXX object tst/unit/CMakeFiles/unit_tests.dir/test_error_checking.cpp.o
[ 94%] Building CXX object tst/unit/CMakeFiles/unit_tests.dir/test_state_descriptor.cpp.o
[ 94%] Building CXX object tst/unit/CMakeFiles/unit_tests.dir/test_partitioning.cpp.o
[ 94%] Building CXX object tst/unit/CMakeFiles/unit_tests.dir/test_unit_integrators.cpp.o
[ 97%] Linking CXX executable kokkos_pi
[ 97%] Built target kokkos_pi
[100%] Linking CXX executable particle-leapfrog
[100%] Built target particle-leapfrog
[100%] Linking CXX executable sparse_advection-example
[100%] Linking CXX executable burgers-benchmark
[100%] Built target sparse_advection-example
[100%] Linking CXX executable pi-example
[100%] Built target burgers-benchmark
[100%] Linking CXX executable poisson-example
[100%] Built target pi-example
[100%] Linking CXX executable performance_tests
[100%] Built target poisson-example
[100%] Built target performance_tests
[100%] Linking CXX executable advection-example
[100%] Linking CXX executable particles-example
[100%] Built target advection-example
[100%] Built target particles-example
[100%] Linking CXX executable particle-tracers
[100%] Built target particle-tracers
[100%] Linking CXX executable stochastic_subgrid-example
[100%] Built target stochastic_subgrid-example
[100%] Linking CXX executable unit_tests
[100%] Built target unit_tests