trilinos / Trilinos

Primary repository for the Trilinos Project
https://trilinos.org/
Other
1.2k stars 564 forks source link

Stokhos: build error for cuda-11.4.2 uvm off PR build #11160

Closed srbdev closed 1 year ago

srbdev commented 1 year ago

Bug Report

@trilinos/stokhos

Description

I'm in the process of re-enabling explicitly disabled packages for the cuda-11.4.2 uvm off PR build and doing so for the Stokhos packages produces a build error. This is using the following branch on my fork of Trilinos.

The error generated during the build step is:

[ 94%] Building CXX object packages/stokhos/test/UnitTest/CMakeFiles/Stokhos_KokkosArrayKernelsUnitTest_Cuda.dir/Stokhos_KokkosArrayKernelsUnitTest_Cuda.cpp.o
cd /scratch/srberna/build/packages/stokhos/test/UnitTest && /projects/sems/install/rhel7-x86_64/sems/tpl/openmpi/4.0.5/gcc/10.1.0/base/bxejupk/bin/mpicxx  -I/scratch/srberna/build -I/scratch/srberna/Trilinos.fork/packages/stokhos/../sacado/test/utils -I/scratch/srberna/build/packages/stokhos/src -I/scratch/srberna/Trilinos.fork/packages/stokhos/src -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/epetra -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/kokkos -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/kokkos/kl -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/kokkos/Serial -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/kokkos/Cuda -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/nox -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/sacado -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/sacado/kokkos -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/sacado/kokkos/vector -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/sacado/kokkos/vector/Fad -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/sacado/kokkos/pce -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/sacado/kokkos/vector/linalg -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/sacado/kokkos/pce/linalg -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/sacado/kokkos/vector/mpicomm -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/sacado/kokkos/pce/mpicomm -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/sacado/kokkos/vector/algorithms -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/sacado/kokkos/pce/algorithms -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/sacado/kokkos/vector/tpetra -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/sacado/kokkos/pce/tpetra -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/sacado/kokkos/vector/belos -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/sacado/kokkos/pce/belos -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/sacado/kokkos/vector/xpetra -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/sacado/kokkos/pce/xpetra -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/sacado/kokkos/vector/amesos2 -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/sacado/kokkos/pce/amesos2 -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/sacado/kokkos/vector/ifpack2 -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/sacado/kokkos/pce/ifpack2 -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/sacado/kokkos/vector/muelu -I/scratch/srberna/Trilinos.fork/packages/stokhos/src/sacado/kokkos/pce/muelu -I/scratch/srberna/build/packages/teuchos/core/src -I/scratch/srberna/Trilinos.fork/packages/teuchos/core/src -I/scratch/srberna/build/packages/kokkos/core/src -I/scratch/srberna/Trilinos.fork/packages/kokkos/core/src -I/scratch/srberna/build/packages/kokkos -I/scratch/srberna/Trilinos.fork/packages/kokkos/core/src/../../tpls/desul/include -I/scratch/srberna/Trilinos.fork/packages/teuchos/parser/src -I/scratch/srberna/Trilinos.fork/packages/teuchos/parameterlist/src -I/scratch/srberna/Trilinos.fork/packages/teuchos/comm/src -I/scratch/srberna/Trilinos.fork/packages/teuchos/numerics/src -I/scratch/srberna/Trilinos.fork/packages/teuchos/remainder/src -I/scratch/srberna/build/packages/teuchos/remainder/src -I/scratch/srberna/build/packages/teuchos/kokkoscompat/src -I/scratch/srberna/Trilinos.fork/packages/teuchos/kokkoscompat/src -I/scratch/srberna/build/packages/teuchos/kokkoscomm/src -I/scratch/srberna/Trilinos.fork/packages/teuchos/kokkoscomm/src -I/scratch/srberna/build/packages/epetraext/src -I/scratch/srberna/Trilinos.fork/packages/epetraext/src -I/scratch/srberna/Trilinos.fork/packages/epetraext/src/transform -I/scratch/srberna/Trilinos.fork/packages/epetraext/src/inout -I/scratch/srberna/Trilinos.fork/packages/epetraext/src/coloring -I/scratch/srberna/Trilinos.fork/packages/epetraext/src/model_evaluator -I/scratch/srberna/Trilinos.fork/packages/epetraext/src/block -I/scratch/srberna/Trilinos.fork/packages/epetraext/src/restrict -I/scratch/srberna/build/packages/epetra/src -I/scratch/srberna/Trilinos.fork/packages/epetra/src -I/scratch/srberna/build/packages/triutils/src -I/scratch/srberna/Trilinos.fork/packages/triutils/src -I/scratch/srberna/build/packages/ifpack/src -I/scratch/srberna/Trilinos.fork/packages/ifpack/src -I/scratch/srberna/Trilinos.fork/packages/common/auxiliarySoftware/SuiteSparse/src/AMD/Include -I/scratch/srberna/Trilinos.fork/packages/common/auxiliarySoftware/SuiteSparse/src/UFconfig -I/scratch/srberna/build/packages/amesos/src -I/scratch/srberna/Trilinos.fork/packages/amesos/src -I/scratch/srberna/build/packages/common/auxiliarySoftware/SuiteSparse/src -I/scratch/srberna/Trilinos.fork/packages/common/auxiliarySoftware/SuiteSparse/src/BTF/Include -I/scratch/srberna/Trilinos.fork/packages/common/auxiliarySoftware/SuiteSparse/src/CAMD/Include -I/scratch/srberna/Trilinos.fork/packages/common/auxiliarySoftware/SuiteSparse/src/CCOLAMD/Include -I/scratch/srberna/Trilinos.fork/packages/common/auxiliarySoftware/SuiteSparse/src/COLAMD/Include -I/scratch/srberna/Trilinos.fork/packages/common/auxiliarySoftware/SuiteSparse/src/KLU/Include -I/scratch/srberna/build/packages/aztecoo/src -I/scratch/srberna/Trilinos.fork/packages/aztecoo/src -I/scratch/srberna/build/packages/ml/src -I/scratch/srberna/Trilinos.fork/packages/ml/src/Include -I/scratch/srberna/Trilinos.fork/packages/ml/src/Comm -I/scratch/srberna/Trilinos.fork/packages/ml/src/Coarsen -I/scratch/srberna/Trilinos.fork/packages/ml/src/FEGrid -I/scratch/srberna/Trilinos.fork/packages/ml/src/Main -I/scratch/srberna/Trilinos.fork/packages/ml/src/Smoother -I/scratch/srberna/Trilinos.fork/packages/ml/src/Krylov -I/scratch/srberna/Trilinos.fork/packages/ml/src/Operator -I/scratch/srberna/Trilinos.fork/packages/ml/src/Utils -I/scratch/srberna/Trilinos.fork/packages/ml/src/RefMaxwell -I/scratch/srberna/Trilinos.fork/packages/ml/src/MatrixFree -I/scratch/srberna/Trilinos.fork/packages/ml/src/MLAPI -I/scratch/srberna/Trilinos.fork/packages/ml/src/LevelWrap -I/scratch/srberna/build/packages/zoltan/src -I/scratch/srberna/Trilinos.fork/packages/zoltan/src/include -I/scratch/srberna/Trilinos.fork/packages/zoltan/src/all -I/scratch/srberna/Trilinos.fork/packages/zoltan/src/coloring -I/scratch/srberna/Trilinos.fork/packages/zoltan/src/graph -I/scratch/srberna/Trilinos.fork/packages/zoltan/src/ha -I/scratch/srberna/Trilinos.fork/packages/zoltan/src/hier -I/scratch/srberna/Trilinos.fork/packages/zoltan/src/hsfc -I/scratch/srberna/Trilinos.fork/packages/zoltan/src/lb -I/scratch/srberna/Trilinos.fork/packages/zoltan/src/matrix -I/scratch/srberna/Trilinos.fork/packages/zoltan/src/order -I/scratch/srberna/Trilinos.fork/packages/zoltan/src/par -I/scratch/srberna/Trilinos.fork/packages/zoltan/src/params -I/scratch/srberna/Trilinos.fork/packages/zoltan/src/tpls -I/scratch/srberna/Trilinos.fork/packages/zoltan/src/phg -I/scratch/srberna/Trilinos.fork/packages/zoltan/src/rcb -I/scratch/srberna/Trilinos.fork/packages/zoltan/src/reftree -I/scratch/srberna/Trilinos.fork/packages/zoltan/src/simple -I/scratch/srberna/Trilinos.fork/packages/zoltan/src/timer -I/scratch/srberna/Trilinos.fork/packages/zoltan/src/Utilities/Communication -I/scratch/srberna/Trilinos.fork/packages/zoltan/src/Utilities/DDirectory -I/scratch/srberna/Trilinos.fork/packages/zoltan/src/Utilities/Timer -I/scratch/srberna/Trilinos.fork/packages/zoltan/src/Utilities/shared -I/scratch/srberna/Trilinos.fork/packages/zoltan/src/zz -I/scratch/srberna/build/packages/galeri/src-epetra -I/scratch/srberna/Trilinos.fork/packages/galeri/src-epetra/../headers -I/scratch/srberna/Trilinos.fork/packages/galeri/src-epetra -I/scratch/srberna/Trilinos.fork/packages/galeri/src-epetra/Maps -I/scratch/srberna/Trilinos.fork/packages/galeri/src-epetra/CRSMatrices -I/scratch/srberna/Trilinos.fork/packages/galeri/src-epetra/FiniteElements -I/scratch/srberna/Trilinos.fork/packages/xpetra/src/CrsGraph -I/scratch/srberna/Trilinos.fork/packages/xpetra/src/CrsMatrix -I/scratch/srberna/Trilinos.fork/packages/xpetra/src/BlockedCrsMatrix -I/scratch/srberna/Trilinos.fork/packages/xpetra/src/DistObject -I/scratch/srberna/Trilinos.fork/packages/xpetra/src/Export -I/scratch/srberna/Trilinos.fork/packages/xpetra/src/Headers -I/scratch/srberna/Trilinos.fork/packages/xpetra/src/Import -I/scratch/srberna/Trilinos.fork/packages/xpetra/src/Map -I/scratch/srberna/Trilinos.fork/packages/xpetra/src/BlockedMap -I/scratch/srberna/Trilinos.fork/packages/xpetra/src/MultiVector -I/scratch/srberna/Trilinos.fork/packages/xpetra/src/BlockedMultiVector -I/scratch/srberna/Trilinos.fork/packages/xpetra/src/BlockedVector -I/scratch/srberna/Trilinos.fork/packages/xpetra/src/Operator -I/scratch/srberna/Trilinos.fork/packages/xpetra/src/Platform -I/scratch/srberna/Trilinos.fork/packages/xpetra/src/RowGraph -I/scratch/srberna/Trilinos.fork/packages/xpetra/src/RowMatrix -I/scratch/srberna/Trilinos.fork/packages/xpetra/src/Utils -I/scratch/srberna/Trilinos.fork/packages/xpetra/src/Utils/ForwardDeclaration -I/scratch/srberna/Trilinos.fork/packages/xpetra/src/Vector -I/scratch/srberna/build/packages/xpetra/src -I/scratch/srberna/build/packages/kokkos/containers/src -I/scratch/srberna/Trilinos.fork/packages/kokkos/containers/src -I/scratch/srberna/Trilinos.fork/packages/tpetra/tsqr/src -I/scratch/srberna/build/packages/tpetra/tsqr/src -I/scratch/srberna/build/packages/kokkos-kernels/src -I/scratch/srberna/Trilinos.fork/packages/kokkos-kernels/src -I/scratch/srberna/Trilinos.fork/packages/kokkos-kernels/src/impl -I/scratch/srberna/build/packages/kokkos-kernels/src/impl -I/scratch/srberna/Trilinos.fork/packages/kokkos-kernels/src/impl/tpls -I/scratch/srberna/Trilinos.fork/packages/kokkos-kernels/src/blas -I/scratch/srberna/Trilinos.fork/packages/kokkos-kernels/src/blas/impl -I/scratch/srberna/Trilinos.fork/packages/kokkos-kernels/src/sparse -I/scratch/srberna/Trilinos.fork/packages/kokkos-kernels/src/sparse/impl -I/scratch/srberna/Trilinos.fork/packages/kokkos-kernels/src/graph -I/scratch/srberna/Trilinos.fork/packages/kokkos-kernels/src/graph/impl -I/scratch/srberna/Trilinos.fork/packages/kokkos-kernels/src/batched -I/scratch/srberna/Trilinos.fork/packages/kokkos-kernels/src/batched/dense -I/scratch/srberna/Trilinos.fork/packages/kokkos-kernels/src/batched/dense/impl -I/scratch/srberna/Trilinos.fork/packages/kokkos-kernels/src/batched/sparse -I/scratch/srberna/Trilinos.fork/packages/kokkos-kernels/src/batched/sparse/impl -I/scratch/srberna/Trilinos.fork/packages/kokkos-kernels/src/common -I/scratch/srberna/build/packages/kokkos/algorithms/src -I/scratch/srberna/Trilinos.fork/packages/kokkos/algorithms/src -I/scratch/srberna/Trilinos.fork/packages/tpetra/core/compat -I/scratch/srberna/build/packages/tpetra/core/compat -I/scratch/srberna/Trilinos.fork/packages/tpetra/core/src -I/scratch/srberna/Trilinos.fork/packages/tpetra/core/src/kokkos_refactor -I/scratch/srberna/build/packages/tpetra/core/src -I/scratch/srberna/Trilinos.fork/packages/tpetra/core/inout -I/scratch/srberna/build/packages/tpetra/core/inout -I/scratch/srberna/Trilinos.fork/packages/tpetra/core/ext -I/scratch/srberna/build/packages/tpetra/core/ext -I/scratch/srberna/Trilinos.fork/packages/thyra/core/src -I/scratch/srberna/Trilinos.fork/packages/thyra/core/src/interfaces/operator_vector/fundamental -I/scratch/srberna/Trilinos.fork/packages/thyra/core/src/interfaces/operator_vector/extended -I/scratch/srberna/Trilinos.fork/packages/thyra/core/src/support/operator_vector/client_support -I/scratch/srberna/Trilinos.fork/packages/thyra/core/src/support/operator_vector/adapter_support -I/scratch/srberna/Trilinos.fork/packages/thyra/core/src/interfaces/operator_solve/fundamental -I/scratch/srberna/Trilinos.fork/packages/thyra/core/src/interfaces/operator_solve/extended -I/scratch/srberna/Trilinos.fork/packages/thyra/core/src/support/operator_solve/client_support -I/scratch/srberna/Trilinos.fork/packages/thyra/core/src/interfaces/nonlinear/model_evaluator/fundamental -I/scratch/srberna/Trilinos.fork/packages/thyra/core/src/support/nonlinear/model_evaluator/client_support -I/scratch/srberna/Trilinos.fork/packages/thyra/core/src/interfaces/nonlinear/solvers/fundamental -I/scratch/srberna/Trilinos.fork/packages/thyra/core/src/support/nonlinear/solvers/client_support -I/scratch/srberna/build/packages/thyra/core/src -I/scratch/srberna/Trilinos.fork/packages/thyra/core/example/operator_vector -I/scratch/srberna/Trilinos.fork/packages/rtop/src -I/scratch/srberna/Trilinos.fork/packages/rtop/src/interfaces -I/scratch/srberna/Trilinos.fork/packages/rtop/src/support -I/scratch/srberna/Trilinos.fork/packages/rtop/src/ops_lib -I/scratch/srberna/Trilinos.fork/packages/rtop/src/lapack -I/scratch/srberna/build/packages/rtop/src -I/scratch/srberna/Trilinos.fork/packages/thyra/adapters/epetra/src -I/scratch/srberna/Trilinos.fork/packages/thyra/adapters/epetraext/src/model_evaluator -I/scratch/srberna/Trilinos.fork/packages/thyra/adapters/epetraext/src/transformer -I/scratch/srberna/Trilinos.fork/packages/thyra/adapters/tpetra/src -I/scratch/srberna/Trilinos.fork/packages/xpetra/sup/Matrix -I/scratch/srberna/Trilinos.fork/packages/xpetra/sup/StridedMap -I/scratch/srberna/Trilinos.fork/packages/xpetra/sup/Utils -I/scratch/srberna/build/packages/xpetra/sup -I/scratch/srberna/Trilinos.fork/packages/galeri/src-xpetra -I/scratch/srberna/build/packages/galeri/src-xpetra -I/scratch/srberna/Trilinos.fork/packages/galeri/src-xpetra/../src-epetra -I/scratch/srberna/build/packages/galeri/src-xpetra/../src-epetra -I/scratch/srberna/Trilinos.fork/packages/galeri/src-xpetra/../headers -I/scratch/srberna/build/packages/isorropia/src -I/scratch/srberna/Trilinos.fork/packages/isorropia/src -I/scratch/srberna/Trilinos.fork/packages/isorropia/src/epetra -I/scratch/srberna/Trilinos.fork/packages/isorropia/src/epetra/zoltanLib -I/scratch/srberna/build/packages/anasazi/src -I/scratch/srberna/Trilinos.fork/packages/anasazi/src -I/scratch/srberna/Trilinos.fork/packages/anasazi/src/../thyra/src -I/scratch/srberna/Trilinos.fork/packages/anasazi/src/../tpetra/src -I/scratch/srberna/build/packages/belos/src -I/scratch/srberna/Trilinos.fork/packages/belos/src -I/scratch/srberna/build/packages/belos/epetra/src -I/scratch/srberna/Trilinos.fork/packages/belos/epetra/src -I/scratch/srberna/build/packages/belos/tpetra/src -I/scratch/srberna/Trilinos.fork/packages/belos/tpetra/src -I/scratch/srberna/build/packages/belos/xpetra/src -I/scratch/srberna/Trilinos.fork/packages/belos/xpetra/src -I/scratch/srberna/build/packages/anasazi/epetra/src -I/scratch/srberna/Trilinos.fork/packages/anasazi/epetra/src -I/scratch/srberna/build/packages/anasazi/epetra/util/ModeLaplace -I/scratch/srberna/Trilinos.fork/packages/anasazi/epetra/util/ModeLaplace -I/scratch/srberna/build/packages/anasazi/tpetra/src -I/scratch/srberna/Trilinos.fork/packages/anasazi/tpetra/src -I/scratch/srberna/build/packages/sacado/src -I/scratch/srberna/Trilinos.fork/packages/sacado/src -I/scratch/srberna/Trilinos.fork/packages/sacado/src/new_design -I/scratch/srberna/Trilinos.fork/packages/sacado/src/template -I/scratch/srberna/Trilinos.fork/packages/sacado/src/parameter -I/scratch/srberna/Trilinos.fork/packages/sacado/src/mpl -I/scratch/srberna/build/packages/nox/src -I/scratch/srberna/Trilinos.fork/packages/nox/src -I/scratch/srberna/Trilinos.fork/packages/nox/src-thyra -I/scratch/srberna/Trilinos.fork/packages/nox/src-tpetra -I/scratch/srberna/Trilinos.fork/packages/stratimikos/adapters/ifpack/src -I/scratch/srberna/Trilinos.fork -I/scratch/srberna/build/packages/amesos2/src -I/scratch/srberna/Trilinos.fork/packages/amesos2/src -I/scratch/srberna/Trilinos.fork/packages/amesos2/src/KLU2/Include -I/scratch/srberna/Trilinos.fork/packages/amesos2/src/KLU2/Source -I/scratch/srberna/build/packages/kokkos/simd/src -I/scratch/srberna/Trilinos.fork/packages/kokkos/simd/src -I/scratch/srberna/build/packages/shylu/shylu_node/tacho/src -I/scratch/srberna/Trilinos.fork/packages/shylu/shylu_node/tacho/src -I/scratch/srberna/Trilinos.fork/packages/shylu/shylu_node/tacho/src/impl -I/scratch/srberna/Trilinos.fork/packages/stratimikos/adapters/ml/src -I/scratch/srberna/Trilinos.fork/packages/stratimikos/adapters/amesos/src -I/scratch/srberna/Trilinos.fork/packages/stratimikos/adapters/aztecoo/src -I/scratch/srberna/Trilinos.fork/packages/stratimikos/adapters/amesos2/src -I/scratch/srberna/build/packages/stratimikos/adapters/amesos2/src -I/scratch/srberna/Trilinos.fork/packages/stratimikos/adapters/belos/src -I/scratch/srberna/build/packages/stratimikos/adapters/belos/src -I/scratch/srberna/build/packages/stratimikos/adapters/belos/src/../../../src -I/scratch/srberna/build/packages/stratimikos/src -I/scratch/srberna/Trilinos.fork/packages/stratimikos/src -I/scratch/srberna/build/packages/teko/src -I/scratch/srberna/Trilinos.fork/packages/teko/src -I/scratch/srberna/Trilinos.fork/packages/teko/src/NS -I/scratch/srberna/Trilinos.fork/packages/teko/src/Epetra -I/scratch/srberna/Trilinos.fork/packages/teko/src/Tpetra -I/scratch/srberna/Trilinos.fork/packages/ifpack2/src -I/scratch/srberna/build/packages/ifpack2/src -I/scratch/srberna/Trilinos.fork/packages/zoltan2/core/src -I/scratch/srberna/build/packages/zoltan2/core/src -I/scratch/srberna/Trilinos.fork/packages/zoltan2/core/src/algorithms -I/scratch/srberna/Trilinos.fork/packages/zoltan2/core/src/algorithms/partition -I/scratch/srberna/Trilinos.fork/packages/zoltan2/core/src/algorithms/order -I/scratch/srberna/Trilinos.fork/packages/zoltan2/core/src/algorithms/color -I/scratch/srberna/Trilinos.fork/packages/zoltan2/core/src/algorithms/match -I/scratch/srberna/Trilinos.fork/packages/zoltan2/core/src/algorithms/map -I/scratch/srberna/Trilinos.fork/packages/zoltan2/core/src/algorithms/zoltan -I/scratch/srberna/Trilinos.fork/packages/zoltan2/core/src/environment -I/scratch/srberna/Trilinos.fork/packages/zoltan2/core/src/include -I/scratch/srberna/Trilinos.fork/packages/zoltan2/core/src/input -I/scratch/srberna/Trilinos.fork/packages/zoltan2/core/src/models -I/scratch/srberna/Trilinos.fork/packages/zoltan2/core/src/problems -I/scratch/srberna/Trilinos.fork/packages/zoltan2/core/src/TpetraCrsColorer -I/scratch/srberna/Trilinos.fork/packages/zoltan2/core/src/util -I/scratch/srberna/Trilinos.fork/packages/zoltan2/core/src/directory -I/scratch/srberna/build/packages/shylu/shylu_node/hts/src -I/scratch/srberna/Trilinos.fork/packages/shylu/shylu_node/hts/src -I/scratch/srberna/Trilinos.fork/packages/ifpack2/adapters/thyra -I/scratch/srberna/build/packages/ifpack2/adapters -I/scratch/srberna/Trilinos.fork/packages/nox/src-lapack -I/scratch/srberna/Trilinos.fork/packages/nox/src-epetra -I/scratch/srberna/Trilinos.fork/packages/nox/src-loca/src -I/scratch/srberna/Trilinos.fork/packages/nox/src-loca/src-lapack -I/scratch/srberna/Trilinos.fork/packages/nox/src-loca/src-epetra -I/scratch/srberna/Trilinos.fork/packages/nox/src-loca/src-epetra/continuation-manager -I/scratch/srberna/Trilinos.fork/packages/nox/src-loca/src-thyra -I/scratch/srberna/Trilinos.fork/packages/nox/src-loca/src-tpetra -I/scratch/srberna/Trilinos.fork/packages/nox/src-loca/src-tpetra/../src-thyra -I/scratch/srberna/Trilinos.fork/packages/muelu/src -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Graph -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Graph/BrickAggregation -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Graph/Containers -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Graph/CoupledAggregation -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Graph/HybridAggregation -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Graph/MatrixTransformation -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Graph/PairwiseAggregation -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Graph/StructuredAggregation -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Graph/StructuredAggregation/coupled -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Graph/StructuredAggregation/uncoupled -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Graph/UncoupledAggregation -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Graph/UserAggregation -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Headers -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Interface -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Interface/FacadeClasses -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Misc -I/scratch/srberna/Trilinos.fork/packages/muelu/src/MueCentral -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Rebalancing -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Smoothers -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Transfers/BaseClass -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Transfers/BlackBox -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Smoothers/BlockedSmoothers -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Transfers/BlockedTransfers -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Transfers/Classical -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Transfers/Energy-Minimization -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Transfers/Energy-Minimization/Solvers -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Transfers/GeneralGeometric -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Transfers/Generic -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Transfers/Geometric-Interpolation -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Transfers/Matrix-Free -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Transfers/Petrov-Galerkin-SA -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Transfers/SemiCoarsen -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Transfers/Smoothed-Aggregation -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Transfers/User -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Utils -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Utils/ForwardDeclaration -I/scratch/srberna/Trilinos.fork/packages/muelu/src/../adapters/xpetra -I/scratch/srberna/Trilinos.fork/packages/muelu/src/../adapters/tpetra -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Transfers/PCoarsen -I/scratch/srberna/Trilinos.fork/packages/muelu/src/../adapters/stratimikos -I/scratch/srberna/build/packages/muelu/src -I/scratch/srberna/build/packages/intrepid2/src -I/scratch/srberna/Trilinos.fork/packages/intrepid2/src/Cell -I/scratch/srberna/Trilinos.fork/packages/intrepid2/src/Discretization/Basis -I/scratch/srberna/Trilinos.fork/packages/intrepid2/src/Discretization/FunctionSpaceTools -I/scratch/srberna/Trilinos.fork/packages/intrepid2/src/Discretization/Integration -I/scratch/srberna/Trilinos.fork/packages/intrepid2/src/Orientation -I/scratch/srberna/Trilinos.fork/packages/intrepid2/src/Projection -I/scratch/srberna/Trilinos.fork/packages/intrepid2/src/Shared -I/scratch/srberna/Trilinos.fork/packages/intrepid2/src -I/scratch/srberna/build/packages/shards/src -I/scratch/srberna/Trilinos.fork/packages/shards/src -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Interface/../Graph -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Interface/../Graph/BrickAggregation -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Interface/../Graph/UncoupledAggregation -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Interface/../Graph/UserAggregation -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Interface/../Headers -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Interface/../Misc -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Interface/../MueCentral -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Interface/../Rebalancing -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Interface/../Smoothers -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Interface/../Transfers/BaseClass -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Interface/../Smoothers/BlockedSmoothers -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Interface/../Transfers/BlockedTransfers -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Interface/../Transfers/Generic -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Interface/../Transfers/Energy-Minimization -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Interface/../Transfers/Energy-Minimization/Solvers -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Interface/../Transfers/GeneralGeometric -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Interface/../Transfers/Geometric-Interpolation -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Interface/../Transfers/Matrix-Free -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Interface/../Transfers/Smoothed-Aggregation -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Interface/../Transfers/Petrov-Galerkin-SA -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Interface/../Transfers/User -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Interface/../Transfers/SemiCoarsen -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Interface/../Utils -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Interface/../Utils/ForwardDeclaration -I/scratch/srberna/Trilinos.fork/packages/muelu/src/Interface/../../adapters/tpetra -I/scratch/srberna/build/packages/muelu/src/Interface -I/scratch/srberna/build/packages/muelu/adapters -I/scratch/srberna/Trilinos.fork/packages/muelu/adapters/belos -I/scratch/srberna/Trilinos.fork/packages/muelu/adapters/tpetra -I/scratch/srberna/Trilinos.fork/packages/muelu/adapters/xpetra -I/scratch/srberna/Trilinos.fork/packages/muelu/adapters/stratimikos -isystem /projects/sems/install/rhel7-x86_64/sems/v2/tpl/cuda/11.4.2/gcc/10.1.0/base/ex2t3fn/include -isystem /projects/sems/install/rhel7-x86_64/sems/v2/tpl/boost/1.70.0/gcc/10.1.0/base/appznr6/include -isystem /projects/sems/install/rhel7-x86_64/sems/v2/tpl/metis/5.1.0/gcc/10.1.0/base/u3d32wd/include -isystem /projects/sems/install/rhel7-x86_64/sems/v2/tpl/zlib/1.2.11/gcc/10.1.0/base/rywytxe/include -pedantic -Wall -Wno-long-long -Wwrite-strings -fPIC -Wall -Warray-bounds -Wchar-subscripts -Wcomment -Wenum-compare -Wformat -Wuninitialized -Wmaybe-uninitialized -Wmain -Wnarrowing -Wnonnull -Wparentheses -Wreorder -Wreturn-type -Wsign-compare -Wsequence-point -Wtrigraphs -Wunused-function -Wunused-but-set-variable -Wunused-variable -Wwrite-strings   -expt-extended-lambda -Wext-lambda-captures-this -arch=sm_70  -O3 -DNDEBUG -std=c++17 -MD -MT packages/stokhos/test/UnitTest/CMakeFiles/Stokhos_KokkosArrayKernelsUnitTest_Cuda.dir/Stokhos_KokkosArrayKernelsUnitTest_Cuda.cpp.o -MF CMakeFiles/Stokhos_KokkosArrayKernelsUnitTest_Cuda.dir/Stokhos_KokkosArrayKernelsUnitTest_Cuda.cpp.o.d -o CMakeFiles/Stokhos_KokkosArrayKernelsUnitTest_Cuda.dir/Stokhos_KokkosArrayKernelsUnitTest_Cuda.cpp.o -c /scratch/srberna/Trilinos.fork/packages/stokhos/test/UnitTest/Stokhos_KokkosArrayKernelsUnitTest_Cuda.cpp
/scratch/srberna/Trilinos.fork/packages/stokhos/src/kokkos/Cuda/Stokhos_Cuda_CrsMatrix.hpp(127): error: identifier "cusparseScsrmv" is undefined

/scratch/srberna/Trilinos.fork/packages/stokhos/src/kokkos/Cuda/Stokhos_Cuda_CrsMatrix.hpp(171): error: identifier "cusparseDcsrmv" is undefined

/scratch/srberna/Trilinos.fork/packages/stokhos/src/kokkos/Cuda/Stokhos_Cuda_CrsMatrix.hpp(458): error: identifier "cusparseScsrmm" is undefined

/scratch/srberna/Trilinos.fork/packages/stokhos/src/kokkos/Cuda/Stokhos_Cuda_CrsMatrix.hpp(506): error: identifier "cusparseDcsrmm" is undefined

/scratch/srberna/Trilinos.fork/packages/stokhos/src/kokkos/Cuda/Stokhos_Cuda_CrsMatrix.hpp(641): error: identifier "cusparseScsrmm" is undefined

/scratch/srberna/Trilinos.fork/packages/stokhos/src/kokkos/Cuda/Stokhos_Cuda_CrsMatrix.hpp(706): error: identifier "cusparseDcsrmm" is undefined

6 errors detected in the compilation of "/scratch/srberna/Trilinos.fork/packages/stokhos/test/UnitTest/Stokhos_KokkosArrayKernelsUnitTest_Cuda.cpp".
make[2]: *** [packages/stokhos/test/UnitTest/CMakeFiles/Stokhos_KokkosArrayKernelsUnitTest_Cuda.dir/Stokhos_KokkosArrayKernelsUnitTest_Cuda.cpp.o] Error 1
make[2]: Leaving directory `/scratch/srberna/build'
make[1]: *** [packages/stokhos/test/UnitTest/CMakeFiles/Stokhos_KokkosArrayKernelsUnitTest_Cuda.dir/all] Error 2
make[1]: Leaving directory `/scratch/srberna/build'
make: *** [all] Error 2

It seems to relate to the cuSPARSE library being deprecated for CUDA 11.

Steps to Reproduce

  1. git clone -b framework-pr-cuda11-missing-packages git@github.com:srbdev/Trilinos.git Trilinos.srbdev
  2. Comment out line 1627 in packages/framework/ini-files/config-specs.ini
  3. mkdir build && cd build
  4. source ../Trilinos.srbdev/packages/framework/GenConfig/gen-config.sh rhel7_sems-cuda-11.4.2-sems-gnu-10.1.0-sems-openmpi-4.0.5_release_static_Volta70_no-asan_complex_no-fpic_mpi_pt_no-rdc_no-uvm_deprecated-on_no-package-enables --cmake-fragment cuda-11.cmake ../Trilinos.srbdev
  5. cmake -C cuda-11.cmake -DTrilinos_ENABLE_ALL_PACKAGES=ON ../Trilinos.srbdev/
  6. make -j1 VERBOSE=1
etphipp commented 1 year ago

Duplicate of issue #11084, which I am in the process of fixing. Thanks for reporting though!