trilinos / Trilinos

Primary repository for the Trilinos Project
https://trilinos.org/
Other
1.19k stars 565 forks source link

Xpetra: Undefined references occur when trying to build MueLu tests/examples #7815

Closed amklinv-nnl closed 2 years ago

amklinv-nnl commented 4 years ago

Bug Report

@trilinos/xpetra @aprokop @jrood-nrel @keitat @sethrj

Description

I am trying to add some new features to spack's Trilinos package (the ability to enable Cuda, enable tests, etc) and I ran into this bug when trying to spack install --test root trilinos (meaning install the default packages of Trilinos and run the full test suite). I am using Trilinos 12.18.1, commit 55a75997332636a28afc9db1aee4ae46fe8d93e7.

[ 97%] Linking CXX executable MueLu_Driver.exe
cd /tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/muelu/test/scaling && /usr/bin/cmake -E cmake_link_script CMakeFiles/MueLu_Driver.dir/link.txt --verbose=1
/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/openmpi-3.1.6-alw235mi5gbn7nhjyb73tbcuicmgfl62/bin/mpic++   -DMUMPS_5_0 -std=c++11 -Wno-unused-local-typedefs -O2 -g -DNDEBUG CMakeFiles/MueLu_Driver.dir/Driver.cpp.o -o MueLu_Driver.exe  -Wl,-rpath,/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/muelu/adapters:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/muelu/src/Interface:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/muelu/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/ifpack2/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/belos/xpetra/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/belos/tpetra/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/belos/epetra/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/belos/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/amesos2/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/ml/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/galeri/src-xpetra:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/galeri/src-epetra:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/ifpack/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/aztecoo/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/zoltan2/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/amesos/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/common/auxiliarySoftware/SuiteSparse/src:/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/mumps-5.3.3-32pnjawyh6r234qqjepulz5rfwegyjoc/lib:/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/netlib-scalapack-2.1.0-6oblll7nmw56jtghr4xmzrx4xkrywftz/lib:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/xpetra/sup:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/xpetra/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/tpetra/core/ext:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/tpetra/core/inout:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/tpetra/core/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/tpetra/tsqr/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/tpetra/classic/LinAlg:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/tpetra/classic/NodeAPI:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/tpetra/classic/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/epetraext/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/triutils/src:/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/suite-sparse-5.7.2-glz64ts6ri4a2nz6zwymgmhpw5afln3a/lib:/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/hypre-2.18.2-udlmyypbi4vmgbm3ljjmsqko67qlqsqx/lib:/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/hdf5-1.10.6-vjujbvaqs6kl2d56f3z2dayfuiw26xhk/lib:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/zoltan/src:/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/parmetis-4.0.3-piwwwegnf34zdjhme7fmlyxqb5hjesiz/lib:/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/metis-5.1.0-hrv3iwv3ulqnodxgmypm5dlrfmzj4zkh/lib:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/epetra/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/kokkos-kernels/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/kokkos/algorithms/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/teuchos/kokkoscomm/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/teuchos/kokkoscompat/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/teuchos/remainder/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/teuchos/numerics/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/teuchos/comm/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/teuchos/parameterlist/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/teuchos/parser/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/teuchos/core/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/kokkos/containers/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/kokkos/core/src:/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/openblas-0.3.10-alveoyre3ntnz5k2gjnzwfxdfo7e7rhl/lib ../../adapters/libmuelu-adapters.so.12.18.1 ../../src/Interface/libmuelu-interface.so.12.18.1 ../../src/libmuelu.so.12.18.1 ../../../../liblast_lib.a ../../../ifpack2/src/libifpack2.so.12.18.1 ../../../belos/xpetra/src/libbelosxpetra.so.12.18.1 ../../../belos/tpetra/src/libbelostpetra.so.12.18.1 ../../../belos/epetra/src/libbelosepetra.so.12.18.1 ../../../belos/src/libbelos.so.12.18.1 ../../../amesos2/src/libamesos2.so.12.18.1 ../../../ml/src/libml.so.12.18.1 ../../../galeri/src-xpetra/libgaleri-xpetra.so.12.18.1 ../../../galeri/src-epetra/libgaleri-epetra.so.12.18.1 ../../../ifpack/src/libifpack.so.12.18.1 ../../../aztecoo/src/libaztecoo.so.12.18.1 ../../../zoltan2/src/libzoltan2.so.12.18.1 ../../../amesos/src/libamesos.so.12.18.1 ../../../common/auxiliarySoftware/SuiteSparse/src/libtrilinosss.so.12.18.1 /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/mumps-5.3.3-32pnjawyh6r234qqjepulz5rfwegyjoc/lib/libdmumps.so /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/mumps-5.3.3-32pnjawyh6r234qqjepulz5rfwegyjoc/lib/libmumps_common.so /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/mumps-5.3.3-32pnjawyh6r234qqjepulz5rfwegyjoc/lib/libpord.so /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/netlib-scalapack-2.1.0-6oblll7nmw56jtghr4xmzrx4xkrywftz/lib/libscalapack.so ../../../xpetra/sup/libxpetra-sup.so.12.18.1 ../../../xpetra/src/libxpetra.so.12.18.1 ../../../tpetra/core/ext/libtpetraext.so.12.18.1 ../../../tpetra/core/inout/libtpetrainout.so.12.18.1 ../../../tpetra/core/src/libtpetra.so.12.18.1 ../../../tpetra/tsqr/src/libkokkostsqr.so.12.18.1 ../../../tpetra/classic/LinAlg/libtpetraclassiclinalg.so.12.18.1 ../../../tpetra/classic/NodeAPI/libtpetraclassicnodeapi.so.12.18.1 ../../../tpetra/classic/src/libtpetraclassic.so.12.18.1 ../../../epetraext/src/libepetraext.so.12.18.1 ../../../triutils/src/libtriutils.so.12.18.1 /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/suite-sparse-5.7.2-glz64ts6ri4a2nz6zwymgmhpw5afln3a/lib/libumfpack.so /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/suite-sparse-5.7.2-glz64ts6ri4a2nz6zwymgmhpw5afln3a/lib/libamd.so /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/suite-sparse-5.7.2-glz64ts6ri4a2nz6zwymgmhpw5afln3a/lib/libcolamd.so /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/suite-sparse-5.7.2-glz64ts6ri4a2nz6zwymgmhpw5afln3a/lib/libcholmod.so /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/suite-sparse-5.7.2-glz64ts6ri4a2nz6zwymgmhpw5afln3a/lib/libsuitesparseconfig.so /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/hypre-2.18.2-udlmyypbi4vmgbm3ljjmsqko67qlqsqx/lib/libHYPRE.so /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/hdf5-1.10.6-vjujbvaqs6kl2d56f3z2dayfuiw26xhk/lib/libhdf5.so /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/zlib-1.2.11-qqcl66l272j2nd7kgxq47zzybm7fyl7o/lib/libz.so /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/hdf5-1.10.6-vjujbvaqs6kl2d56f3z2dayfuiw26xhk/lib/libhdf5_hl.so ../../../zoltan/src/libzoltan.so.12.18.1 /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/parmetis-4.0.3-piwwwegnf34zdjhme7fmlyxqb5hjesiz/lib/libparmetis.so /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/metis-5.1.0-hrv3iwv3ulqnodxgmypm5dlrfmzj4zkh/lib/libmetis.so -lm ../../../epetra/src/libepetra.so.12.18.1 ../../../kokkos-kernels/src/libkokkoskernels.so.12.18.1 ../../../kokkos/algorithms/src/libkokkosalgorithms.so.12.18.1 ../../../teuchos/kokkoscomm/src/libteuchoskokkoscomm.so.12.18.1 ../../../teuchos/kokkoscompat/src/libteuchoskokkoscompat.so.12.18.1 ../../../teuchos/remainder/src/libteuchosremainder.so.12.18.1 ../../../teuchos/numerics/src/libteuchosnumerics.so.12.18.1 ../../../teuchos/comm/src/libteuchoscomm.so.12.18.1 ../../../teuchos/parameterlist/src/libteuchosparameterlist.so.12.18.1 ../../../teuchos/parser/src/libteuchosparser.so.12.18.1 ../../../teuchos/core/src/libteuchoscore.so.12.18.1 ../../../kokkos/containers/src/libkokkoscontainers.so.12.18.1 ../../../kokkos/core/src/libkokkoscore.so.12.18.1 /usr/lib/x86_64-linux-gnu/libdl.so /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/openblas-0.3.10-alveoyre3ntnz5k2gjnzwfxdfo7e7rhl/lib/libopenblas.so -L/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-7.2.0/gcc-9.3.0-zscvxh4kxiomypjbg5t3asneotueayuq/lib/gcc/x86_64-pc-linux-gnu/9.3.0/../../../../lib64/ -lgfortran
CMakeFiles/MueLu_Driver.dir/Driver.cpp.o: In function `Xpetra::EpetraOperator<long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> >::getDomainMap() const':
/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-src/packages/xpetra/src/Operator/Xpetra_EpetraOperator.hpp:79: undefined reference to `Teuchos::RCP<Xpetra::Map<int, long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> > const> const Xpetra::toXpetra<long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> >(Epetra_BlockMap const&)'
CMakeFiles/MueLu_Driver.dir/Driver.cpp.o: In function `Xpetra::EpetraOperator<long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> >::getRangeMap() const':
/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-src/packages/xpetra/src/Operator/Xpetra_EpetraOperator.hpp:87: undefined reference to `Teuchos::RCP<Xpetra::Map<int, long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> > const> const Xpetra::toXpetra<long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> >(Epetra_BlockMap const&)'
CMakeFiles/MueLu_Driver.dir/Driver.cpp.o: In function `MueLu::HierarchyManager<double, int, long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> >::SetupHierarchy(MueLu::Hierarchy<double, int, long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> >&) const':
/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-src/packages/xpetra/src/Operator/Xpetra_EpetraOperator.hpp:79: undefined reference to `Teuchos::RCP<Xpetra::Map<int, long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> > const> const Xpetra::toXpetra<long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> >(Epetra_BlockMap const&)'
CMakeFiles/MueLu_Driver.dir/Driver.cpp.o: In function `void SystemSolve<double, int, long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> >(Teuchos::RCP<Xpetra::Matrix<double, int, long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> > >&, Teuchos::RCP<Xpetra::MultiVector<double, int, long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> > >&, Teuchos::RCP<Xpetra::MultiVector<double, int, long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> > >&, Teuchos::RCP<MueLu::Hierarchy<double, int, long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> > >&, Teuchos::RCP<Xpetra::Operator<double, int, long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> > >&, Teuchos::basic_FancyOStream<char, std::char_traits<char> >&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, bool, bool, bool, int, int, bool, bool, int, double)':
/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-src/packages/muelu/test/scaling/DriverCore.hpp:274: undefined reference to `Epetra_MultiVector& Xpetra::toEpetra<long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> >(Xpetra::MultiVector<double, int, long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> >&)'
/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-src/packages/muelu/test/scaling/DriverCore.hpp:275: undefined reference to `Epetra_MultiVector& Xpetra::toEpetra<long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> >(Xpetra::MultiVector<double, int, long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> >&)'
collect2: error: ld returned 1 exit status
packages/muelu/test/scaling/CMakeFiles/MueLu_Driver.dir/build.make:165: recipe for target 'packages/muelu/test/scaling/MueLu_Driver.exe' failed
make[2]: *** [packages/muelu/test/scaling/MueLu_Driver.exe] Error 1
make[2]: Leaving directory '/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build'
CMakeFiles/Makefile2:66288: recipe for target 'packages/muelu/test/scaling/CMakeFiles/MueLu_Driver.dir/all' failed
make[1]: *** [packages/muelu/test/scaling/CMakeFiles/MueLu_Driver.dir/all] Error 2
make[1]: Leaving directory '/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build'
Makefile:184: recipe for target 'all' failed
make: *** [all] Error 2

It looks a bit like an ETI problem, but I'm not familiar enough with XPetra to fix it myself.

Steps to Reproduce

These are the flags being used by CMake within spack. Please let me know if you need more information.

==> [2020-08-06-17:44:40.010926, 20640] 'cmake' '-G' 'Unix Makefiles' 
'-DCMAKE_INSTALL_PREFIX:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw' 
'-DCMAKE_BUILD_TYPE:STRING=RelWithDebInfo' 
'-DCMAKE_VERBOSE_MAKEFILE:BOOL=ON' 
'-DCMAKE_INSTALL_RPATH_USE_LINK_PATH:BOOL=OFF' 
'-DCMAKE_INSTALL_RPATH:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/lib64;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/glm-0.9.7.1-vhlmsyf7zi6gtzj7r2lwbwtcpvrzrsgd/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/hdf5-1.10.6-vjujbvaqs6kl2d56f3z2dayfuiw26xhk/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/openmpi-3.1.6-alw235mi5gbn7nhjyb73tbcuicmgfl62/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/hwloc-1.11.11-hlaal3qkg72qmvfi5j3rwavxy3sus5aw/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/libpciaccess-0.13.5-tzp4tftuoz3tgbozhaejlpa6papa7xyd/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/libxml2-2.9.10-pyj66asvxa5xasrsqceyofnox4kjcxfo/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/libiconv-1.16-5a5ctqi56sk3okx4sz3pubsqtiemgoeq/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/xz-5.2.5-75nr2727rsud6vwyg62acfq5c6yhvo26/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/zlib-1.2.11-qqcl66l272j2nd7kgxq47zzybm7fyl7o/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/numactl-2.0.12-symolce5bzxzzmmszxjdex22hd4xkt4y/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/hypre-2.18.2-udlmyypbi4vmgbm3ljjmsqko67qlqsqx/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/openblas-0.3.10-alveoyre3ntnz5k2gjnzwfxdfo7e7rhl/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/matio-1.5.13-aq6h2iajtc7qtrpzvi3tqvzvadiro74u/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/metis-5.1.0-hrv3iwv3ulqnodxgmypm5dlrfmzj4zkh/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/mumps-5.3.3-32pnjawyh6r234qqjepulz5rfwegyjoc/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/netlib-scalapack-2.1.0-6oblll7nmw56jtghr4xmzrx4xkrywftz/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/netcdf-c-4.7.3-jfqhyooogiyfyz6ueos3msze2keu3hhl/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/parmetis-4.0.3-piwwwegnf34zdjhme7fmlyxqb5hjesiz/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/suite-sparse-5.7.2-glz64ts6ri4a2nz6zwymgmhpw5afln3a/lib' 
'-DCMAKE_PREFIX_PATH:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/openblas-0.3.10-alveoyre3ntnz5k2gjnzwfxdfo7e7rhl;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/glm-0.9.7.1-vhlmsyf7zi6gtzj7r2lwbwtcpvrzrsgd;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/hdf5-1.10.6-vjujbvaqs6kl2d56f3z2dayfuiw26xhk;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/matio-1.5.13-aq6h2iajtc7qtrpzvi3tqvzvadiro74u;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/metis-5.1.0-hrv3iwv3ulqnodxgmypm5dlrfmzj4zkh;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/suite-sparse-5.7.2-glz64ts6ri4a2nz6zwymgmhpw5afln3a;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/openmpi-3.1.6-alw235mi5gbn7nhjyb73tbcuicmgfl62;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/netcdf-c-4.7.3-jfqhyooogiyfyz6ueos3msze2keu3hhl;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/parmetis-4.0.3-piwwwegnf34zdjhme7fmlyxqb5hjesiz;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/mumps-5.3.3-32pnjawyh6r234qqjepulz5rfwegyjoc;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/netlib-scalapack-2.1.0-6oblll7nmw56jtghr4xmzrx4xkrywftz;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/hypre-2.18.2-udlmyypbi4vmgbm3ljjmsqko67qlqsqx' 
'-DTrilinos_VERBOSE_CONFIGURE:BOOL=OFF' 
'-DTrilinos_ENABLE_TESTS:BOOL=ON' 
'-DTrilinos_ENABLE_EXAMPLES:BOOL=OFF' 
'-DTrilinos_ENABLE_CXX11:BOOL=ON' 
'-DBUILD_SHARED_LIBS:BOOL=ON' 
'-DTrilinos_ENABLE_DEBUG:BOOL=OFF' 
'-DTPL_ENABLE_MPI:BOOL=ON' 
'-DCMAKE_C_COMPILER:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/openmpi-3.1.6-alw235mi5gbn7nhjyb73tbcuicmgfl62/bin/mpicc' 
'-DCMAKE_CXX_COMPILER:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/openmpi-3.1.6-alw235mi5gbn7nhjyb73tbcuicmgfl62/bin/mpic++' 
'-DCMAKE_Fortran_COMPILER:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/openmpi-3.1.6-alw235mi5gbn7nhjyb73tbcuicmgfl62/bin/mpif90' 
'-DMPI_BASE_DIR:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/openmpi-3.1.6-alw235mi5gbn7nhjyb73tbcuicmgfl62' 
'-DTPL_ENABLE_CUDA:BOOL=OFF' 
'-DTrilinos_ENABLE_ALL_OPTIONAL_PACKAGES:BOOL=OFF' 
'-DTrilinos_ENABLE_Amesos:BOOL=ON' 
'-DTrilinos_ENABLE_Amesos2:BOOL=ON' 
'-DTrilinos_ENABLE_Anasazi:BOOL=ON' 
'-DTrilinos_ENABLE_AztecOO:BOOL=ON' 
'-DTrilinos_ENABLE_Belos:BOOL=ON' 
'-DTrilinos_ENABLE_Epetra:BOOL=ON' 
'-DTrilinos_ENABLE_EpetraExt:BOOL=ON' 
'-DTrilinos_ENABLE_Ifpack:BOOL=ON' 
'-DTrilinos_ENABLE_Ifpack2:BOOL=ON' 
'-DTrilinos_ENABLE_Intrepid:BOOL=OFF' 
'-DTrilinos_ENABLE_Intrepid2:BOOL=OFF' 
'-DTrilinos_ENABLE_Isorropia:BOOL=OFF' 
'-DTrilinos_ENABLE_Kokkos:BOOL=ON' 
'-DTrilinos_ENABLE_MiniTensor:BOOL=OFF' 
'-DTrilinos_ENABLE_Mesquite:BOOL=OFF' 
'-DTrilinos_ENABLE_ML:BOOL=ON' 
'-DTrilinos_ENABLE_MueLu:BOOL=ON' 
'-DTrilinos_ENABLE_NOX:BOOL=OFF' 
'-DTrilinos_ENABLE_Piro:BOOL=OFF' 
'-DTrilinos_ENABLE_Phalanx:BOOL=OFF' 
'-DTrilinos_ENABLE_PyTrilinos:BOOL=OFF' 
'-DTrilinos_ENABLE_ROL:BOOL=OFF' 
'-DTrilinos_ENABLE_Rythmos:BOOL=OFF' 
'-DTrilinos_ENABLE_Sacado:BOOL=ON' 
'-DTrilinos_ENABLE_Shards:BOOL=OFF' 
'-DTrilinos_ENABLE_ShyLU:BOOL=OFF' 
'-DTrilinos_ENABLE_STK:BOOL=OFF' 
'-DTrilinos_ENABLE_Stratimikos:BOOL=OFF' 
'-DTrilinos_ENABLE_Teko:BOOL=OFF' 
'-DTrilinos_ENABLE_Tempus:BOOL=OFF' 
'-DTrilinos_ENABLE_Teuchos:BOOL=ON' 
'-DTrilinos_ENABLE_Tpetra:BOOL=ON' 
'-DTrilinos_ENABLE_Zoltan:BOOL=ON' 
'-DTrilinos_ENABLE_Zoltan2:BOOL=ON' 
'-DUSE_XSDK_DEFAULTS:BOOL=OFF' 
'-DTrilinos_ENABLE_SEACAS:BOOL=ON' 
'-DTrilinos_ENABLE_SEACASExodus:BOOL=ON' 
'-DTrilinos_ENABLE_SEACASIoss:BOOL=ON' 
'-DTrilinos_ENABLE_SEACASEpu:BOOL=ON' 
'-DTrilinos_ENABLE_SEACASExodiff:BOOL=ON' 
'-DTrilinos_ENABLE_SEACASNemspread:BOOL=ON' 
'-DTrilinos_ENABLE_SEACASNemslice:BOOL=ON' 
'-DTrilinos_ENABLE_SEACASChaco:BOOL=OFF' 
'-DTrilinos_ENABLE_SEACASNemslice:BOOL=OFF' 
'-DTPL_ENABLE_BLAS:BOOL=ON' 
'-DBLAS_LIBRARY_NAMES:STRING=openblas' 
'-DBLAS_LIBRARY_DIRS:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/openblas-0.3.10-alveoyre3ntnz5k2gjnzwfxdfo7e7rhl/lib' 
'-DTPL_ENABLE_LAPACK:BOOL=ON' 
'-DLAPACK_LIBRARY_NAMES:STRING=openblas' 
'-DLAPACK_LIBRARY_DIRS:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/openblas-0.3.10-alveoyre3ntnz5k2gjnzwfxdfo7e7rhl/lib' 
'-DTPL_ENABLE_GLM:BOOL=ON' 
'-DTPL_ENABLE_Matio:BOOL=ON' 
'-DTPL_ENABLE_X11:BOOL=OFF' 
'-DTrilinos_ENABLE_Gtest:BOOL=ON' 
'-DTPL_ENABLE_Netcdf:BOOL=ON' 
'-DNetCDF_ROOT:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/netcdf-c-4.7.3-jfqhyooogiyfyz6ueos3msze2keu3hhl' 
'-DTPL_ENABLE_HYPRE:BOOL=ON' 
'-DHYPRE_INCLUDE_DIRS:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/hypre-2.18.2-udlmyypbi4vmgbm3ljjmsqko67qlqsqx/include' 
'-DHYPRE_LIBRARY_DIRS:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/hypre-2.18.2-udlmyypbi4vmgbm3ljjmsqko67qlqsqx/lib' 
'-DTPL_ENABLE_Boost:BOOL=OFF' 
'-DTPL_ENABLE_HDF5:BOOL=ON' 
'-DHDF5_INCLUDE_DIRS:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/hdf5-1.10.6-vjujbvaqs6kl2d56f3z2dayfuiw26xhk/include' 
'-DHDF5_LIBRARY_DIRS:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/hdf5-1.10.6-vjujbvaqs6kl2d56f3z2dayfuiw26xhk/lib' 
'-DTPL_ENABLE_Cholmod:BOOL=OFF' 
'-DTPL_ENABLE_UMFPACK:BOOL=ON' 
'-DUMFPACK_LIBRARY_DIRS:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/suite-sparse-5.7.2-glz64ts6ri4a2nz6zwymgmhpw5afln3a/lib' 
'-DUMFPACK_INCLUDE_DIRS:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/suite-sparse-5.7.2-glz64ts6ri4a2nz6zwymgmhpw5afln3a/include' 
'-DUMFPACK_LIBRARY_NAMES:STRING=umfpack;amd;colamd;cholmod;suitesparseconfig' 
'-DTPL_ENABLE_METIS:BOOL=ON' 
'-DTPL_ENABLE_ParMETIS:BOOL=ON' 
'-DMETIS_LIBRARY_DIRS:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/metis-5.1.0-hrv3iwv3ulqnodxgmypm5dlrfmzj4zkh/lib' 
'-DMETIS_LIBRARY_NAMES:STRING=metis' 
'-DTPL_METIS_INCLUDE_DIRS:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/metis-5.1.0-hrv3iwv3ulqnodxgmypm5dlrfmzj4zkh/include' 
'-DTPL_ENABLE_ParMETIS:BOOL=ON' 
'-DParMETIS_LIBRARY_DIRS:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/parmetis-4.0.3-piwwwegnf34zdjhme7fmlyxqb5hjesiz/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/metis-5.1.0-hrv3iwv3ulqnodxgmypm5dlrfmzj4zkh/lib' 
'-DParMETIS_LIBRARY_NAMES:STRING=parmetis;metis' 
'-DTPL_ParMETIS_INCLUDE_DIRS:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/parmetis-4.0.3-piwwwegnf34zdjhme7fmlyxqb5hjesiz/include;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/metis-5.1.0-hrv3iwv3ulqnodxgmypm5dlrfmzj4zkh/include' 
'-DTPL_ENABLE_MUMPS:BOOL=ON' 
'-DTPL_ENABLE_SCALAPACK:BOOL=ON' 
'-DMUMPS_LIBRARY_DIRS:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/mumps-5.3.3-32pnjawyh6r234qqjepulz5rfwegyjoc/lib' 
'-DMUMPS_LIBRARY_NAMES:STRING=dmumps;mumps_common;pord' 
'-DSCALAPACK_LIBRARY_NAMES:STRING=scalapack' 
'-DSCALAPACK_LIBRARY_DIRS:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/netlib-scalapack-2.1.0-6oblll7nmw56jtghr4xmzrx4xkrywftz/lib' 
'-DTPL_ENABLE_SuperLUDist:BOOL=OFF' 
'-DTPL_ENABLE_SuperLU:BOOL=OFF' 
'-DTPL_ENABLE_Pnetcdf:BOOL=OFF' 
'-DTPL_ENABLE_Zlib:BOOL=OFF' 
'-DTPL_ENABLE_CGNS:BOOL=OFF' 
'-DTPL_ENABLE_ADIOS2:BOOL=OFF' 
'-DTrilinos_ENABLE_OpenMP:BOOL=OFF' 
'-DTrilinos_ENABLE_Fortran:BOOL=ON' 
'-DTrilinos_EXTRA_LINK_FLAGS:STRING=-L/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-7.2.0/gcc-9.3.0-zscvxh4kxiomypjbg5t3asneotueayuq/lib/gcc/x86_64-pc-linux-gnu/9.3.0/../../../../lib64/ -lgfortran' 
'-DTeuchos_ENABLE_COMPLEX:BOOL=OFF' 
'-DTeuchos_ENABLE_FLOAT:BOOL=OFF' 
'-DTrilinos_ENABLE_EXPLICIT_INSTANTIATION:BOOL=ON' 
'-DTpetra_INST_DOUBLE:BOOL=ON' 
'-DTpetra_INST_INT_INT:BOOL=ON' 
'-DTpetra_INST_INT_LONG:BOOL=ON' 
'-DTpetra_INST_INT_LONG_LONG:BOOL=OFF' 
'-DTpetra_INST_COMPLEX_DOUBLE:BOOL=OFF' 
'-DTpetra_INST_COMPLEX_FLOAT:BOOL=OFF' 
'-DTpetra_INST_FLOAT:BOOL=OFF' 
'-DTpetra_INST_SERIAL:BOOL=ON' 
'-DCMAKE_INSTALL_NAME_DIR:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/lib' 
'-DCMAKE_CXX_FLAGS:STRING=-DMUMPS_5_0' 
'-DTrilinos_ENABLE_Pike:BOOL=OFF' '/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-src'
sethrj commented 4 years ago

Yuck. Literally an hour ago I also hit a trilinos/xpetra/muelu build error (https://github.com/spack/spack/pull/17971).

Can you try building trilinos with gotype=long_long? I heard a rumor that the <int, long long> instantiation will eventually be the only one supported; and so it's possible that it's the most well tested.

cgcgcg commented 4 years ago

-DTpetra_INST_INT_LONG:BOOL=ON might be the issue. Unless that instantiation is crucial, could you try switching it off?

sethrj commented 4 years ago

The trilinos spack recipe sets gotype=long by default, so that's why you're getting -DTpetra_INST_INT_LONG:BOOL=ON.

It also looks like you're getting Tpetra_INST_INT_INT turned on as well, which seems impossible from the spack recipe and isn't consistent with the trilinos builds that I have. Not sure what's going on there...

Anyway @amklinv-nnl , setting gotype=long_long will turn off Tpetra_INST_INT_LONG as @cgcgcg recommends and will enable Tpetra_INST_INT_LONG_LONG.

amklinv-nnl commented 4 years ago

I'll test this at the end of the day. (The machine I usually use is down, and it takes my laptop a few hours to attempt this.)

The trilinos recipe on my branch enables Tpetra_INST_INT_INT if Epetra and Xpetra are both enabled to fix this error:

  >> 979    CMake Error at packages/xpetra/CMakeLists.txt:120 (MESSAGE):
     980      If Xpetra Epetra support is enabled and Epetra 32-bit global indices are
     981      enabled, Xpetra requires that you enable Tpetra_INST_INT_INT

Assuming long_long works, I'll modify the default gotype in spack.

aprokop commented 4 years ago

Assuming long_long works, I'll modify the default gotype in spack.

@amklinv-nnl There may be challenges doing that, see spack/spack#14215.

jhux2 commented 4 years ago

@trilinos/xpetra

amklinv-nnl commented 4 years ago

long_long worked for me. My concern is that I am adding support to the spack trilinos package to build and run our test suite (https://github.com/spack/spack/pull/17900), and when I do, spack's default settings for Trilinos are going to result in the build error I saw for users that use the spack testing flags. I would hate for that to be somebody's first experience with Trilinos.

sethrj commented 4 years ago

@amklinv-nnl For any selection of variants/dependencies that causes a build/configure error, you should add a conflicts statement to the package recipe. Because Trilinos has a basically boundless list of variants and options, this list is long, but at least it'll be a way to catch the error before the project even tries to build.

cgcgcg commented 4 years ago

@amklinv-nnl Have you tried Trilinos develop? It seems to build fine with long..

csiefer2 commented 4 years ago

The trilinos spack recipe sets gotype=long by default, so that's why you're getting -DTpetra_INST_INT_LONG:BOOL=ON.

That's horrific. Who decided to enable a capability that isn't tested by default?

keitat commented 4 years ago

Is it default? I think it is related to the problem with phist package which requires trilinos variant gotype=long_long.

keitat commented 4 years ago

deal.II wants gotype=int..... Need to discuss among xSDK members.

csiefer2 commented 4 years ago

Lesson: Never rely on somebody else's spack settings for software as complicated as Trilinos (or even Hypre). It won't set what you want.

keitat commented 4 years ago

We should set gotype=int as the default. Should I report to Spack issues?

sethrj commented 4 years ago

@keitat Don't you want gotype=long_long? I thought that Trilinos 13 was moving to hard-coding long long for global types.

keitat commented 4 years ago

That's right, @sethrj . Then, we need to ask deal.II team to change its Trilinos requirements....

sethrj commented 4 years ago

Ask them "what's the deal.II with using gotype=int" 😆

csiefer2 commented 4 years ago

@sethrj Dunno where you heard that. Trilinos has no plans to hard-code long long for global types.

keitat commented 4 years ago

@csiefer2 What is the exact plan with version 13? I am confused....

keitat commented 4 years ago

Bringing back the old issue: https://github.com/xsdk-project/xsdk-issues/issues/104 Need to double check the official decision of xSDK.

keitat commented 4 years ago

@amklinv-nnl is putting a new logic in Spack. https://github.com/spack/spack/commit/0556e27e9cf573bafa9c29b77e00aa37352fdb42

sethrj commented 4 years ago

@jwillenbring @aprokop Apparently I misunderstood our conversation about global/local type simplification in Trilinos 13. I thought Trilinos was moving to hardcode int32_t, uint64_t for the local/global pairs and remove a huge swath of templating. Looking at the 13 release tag, that's clearly not the case for tpetra... what did I miss?

jwillenbring commented 4 years ago

@sethrj Please see https://github.com/trilinos/Trilinos/wiki/Trilinos_v12_code_deprecation.pdf. This explains it more clearly than I can.

sethrj commented 4 years ago

Excellent, thanks @jwillenbring ! It sounds like the change is that multiple simultaneous types will no longer be supported (this is consistent with the spack Trilinos package), and that the default instantiation should be int/long long, which is not currently the case.

keitat commented 4 years ago

xSDK team is investigating the index data types of all library packages. I will post it once the preliminary survey is done.

sethrj commented 3 years ago

@keitat Did anything ever come of the index data type interview? I hit this issue recently because e4s is installed on spock with trilinos gotype=long, but some of our software requires gotype=long_long and it seems the xsdk uses gotype=int which seems counterintuitive since we have hit 2 billion unknowns even on pre-exascale systems.

github-actions[bot] commented 2 years ago

This issue has had no activity for 365 days and is marked for closure. It will be closed after an additional 30 days of inactivity. If you would like to keep this issue open please add a comment and/or remove the MARKED_FOR_CLOSURE label. If this issue should be kept open even with no activity beyond the time limits you can add the label DO_NOT_AUTOCLOSE. If it is ok for this issue to be closed, feel free to go ahead and close it. Please do not add any comments or change any labels or otherwise touch this issue unless your intention is to reset the inactivity counter for an additional year.

github-actions[bot] commented 2 years ago

This issue was closed due to inactivity for 395 days.

sethrj commented 2 years ago

Goodnight sweet prince 😢

lucbv commented 2 years ago

@sethrj do you know if these are still a thing? I do not think we had much activity on this but if this is still a thing we can have another look.

sethrj commented 2 years ago

I think it's just another result of the combinatorial complexity of TriBITS options. I know we were able to work around it by setting some slightly different combination of enables. I think it's fine to close but we can reopen if we hit this again.