search

trilinos / Trilinos

Primary repository for the Trilinos Project
https://trilinos.org/
Other
1.2k stars 564 forks source link

MueLu: Build error with HIP and Complex #11008

Closed jjellio closed 2 years ago

jjellio commented 2 years ago

Bug Report

@trilinos/muelu

Description

I have this error with an ATDM HIP build

I'll need a to dig a little to get the configure line, but it's pretty much ENABLE_ALL_PACKAGES with Complex enabled.

Edit: MueLu_RegionRFactory_kokkos.cpp is the source of the issues (w/out Christian's PR) - rolling back before Peter's PR around July 20th avoids it (see commment below). TenativePFactory I think is okay.

FAILED: packages/muelu/src/CMakeFiles/muelu.dir/Utils/ExplicitInstantiation/MueLu_TentativePFactory_kokkos.cpp.o

MueLu_RegionRFactory_kokkos.cpp.o Fails ``` [4598/5380] Building CXX object packages/muelu/src/CMakeFiles/muelu.dir/Utils/ExplicitInstantiation/MueLu_RegionRFactory_kokkos.cpp.o FAILED: packages/muelu/src/CMakeFiles/muelu.dir/Utils/ExplicitInstantiation/MueLu_RegionRFactory_kokkos.cpp.o /opt/rocm-5.2.0/bin/amdclang++ -Dmuelu_EXPORTS -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Graph -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Graph/BrickAggregation -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Graph/Containers -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Graph/CoupledAggregation -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Graph/HybridAggregation -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Graph/MatrixTransformation -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Graph/PairwiseAggregation -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Graph/StructuredAggregation -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Graph/StructuredAggregation/coupled -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Graph/StructuredAggregation/uncoupled -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Graph/UncoupledAggregation -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Graph/UserAggregation -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Headers -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Interface -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Interface/FacadeClasses -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Misc -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/MueCentral -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Rebalancing -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Smoothers -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/BaseClass -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/BlackBox -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Smoothers/BlockedSmoothers -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/BlockedTransfers -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/Classical -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/Energy-Minimization -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/Energy-Minimization/Solvers -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/GeneralGeometric -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/Generic -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/Geometric-Interpolation -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/Petrov-Galerkin-SA -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/SemiCoarsen -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/Smoothed-Aggregation -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/User -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Utils -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Utils/ForwardDeclaration -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/../adapters/xpetra -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/../adapters/tpetra -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/PCoarsen -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/../adapters/stratimikos -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/muelu/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/teuchos/core/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/teuchos/core/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/kokkos/core/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/kokkos -I/g/g20/jjellio/src/github/Trilinos-a/packages/teuchos/parser/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/teuchos/parameterlist/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/teuchos/comm/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/teuchos/numerics/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/teuchos/remainder/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/teuchos/remainder/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/teuchos/kokkoscompat/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/teuchos/kokkoscompat/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/teuchos/kokkoscomm/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/teuchos/kokkoscomm/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/CrsGraph -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/CrsMatrix -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/BlockedCrsMatrix -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/DistObject -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/Export -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/Headers -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/Import -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/Map -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/BlockedMap -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/MultiVector -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/BlockedMultiVector -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/BlockedVector -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/Operator -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/Platform -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/RowGraph -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/RowMatrix -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/Utils -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/Utils/ForwardDeclaration -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/Vector -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/xpetra/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/kokkos/containers/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/containers/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/tpetra/tsqr/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/tpetra/tsqr/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/kokkos-kernels/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src/impl -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/kokkos-kernels/src/impl -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src/impl/tpls -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src/blas -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src/blas/impl -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src/sparse -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src/sparse/impl -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src/graph -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src/graph/impl -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src/batched -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src/batched/dense -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src/batched/dense/impl -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src/batched/sparse -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src/batched/sparse/impl -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src/common -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/kokkos/algorithms/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/algorithms/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/tpetra/core/compat -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/tpetra/core/compat -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/epetra/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/epetra/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/tpetra/core/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/tpetra/core/src/kokkos_refactor -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/tpetra/core/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/tpetra/core/inout -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/tpetra/core/inout -I/g/g20/jjellio/src/github/Trilinos-a/packages/tpetra/core/ext -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/tpetra/core/ext -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/core/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/core/src/interfaces/operator_vector/fundamental -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/core/src/interfaces/operator_vector/extended -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/core/src/support/operator_vector/client_support -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/core/src/support/operator_vector/adapter_support -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/core/src/interfaces/operator_solve/fundamental -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/core/src/interfaces/operator_solve/extended -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/core/src/support/operator_solve/client_support -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/core/src/interfaces/nonlinear/model_evaluator/fundamental -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/core/src/support/nonlinear/model_evaluator/client_support -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/core/src/interfaces/nonlinear/solvers/fundamental -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/core/src/support/nonlinear/solvers/client_support -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/thyra/core/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/core/example/operator_vector -I/g/g20/jjellio/src/github/Trilinos-a/packages/rtop/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/rtop/src/interfaces -I/g/g20/jjellio/src/github/Trilinos-a/packages/rtop/src/support -I/g/g20/jjellio/src/github/Trilinos-a/packages/rtop/src/ops_lib -I/g/g20/jjellio/src/github/Trilinos-a/packages/rtop/src/lapack -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/rtop/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/adapters/epetra/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/adapters/epetraext/src/model_evaluator -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/adapters/epetraext/src/transformer -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/epetraext/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/epetraext/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/epetraext/src/transform -I/g/g20/jjellio/src/github/Trilinos-a/packages/epetraext/src/inout -I/g/g20/jjellio/src/github/Trilinos-a/packages/epetraext/src/coloring -I/g/g20/jjellio/src/github/Trilinos-a/packages/epetraext/src/model_evaluator -I/g/g20/jjellio/src/github/Trilinos-a/packages/epetraext/src/block -I/g/g20/jjellio/src/github/Trilinos-a/packages/epetraext/src/restrict -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/triutils/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/triutils/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/adapters/tpetra/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/sup/Matrix -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/sup/StridedMap -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/sup/Utils -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/xpetra/sup -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/amesos/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/amesos/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/common/auxiliarySoftware/SuiteSparse/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/common/auxiliarySoftware/SuiteSparse/src/AMD/Include -I/g/g20/jjellio/src/github/Trilinos-a/packages/common/auxiliarySoftware/SuiteSparse/src/BTF/Include -I/g/g20/jjellio/src/github/Trilinos-a/packages/common/auxiliarySoftware/SuiteSparse/src/CAMD/Include -I/g/g20/jjellio/src/github/Trilinos-a/packages/common/auxiliarySoftware/SuiteSparse/src/CCOLAMD/Include -I/g/g20/jjellio/src/github/Trilinos-a/packages/common/auxiliarySoftware/SuiteSparse/src/COLAMD/Include -I/g/g20/jjellio/src/github/Trilinos-a/packages/common/auxiliarySoftware/SuiteSparse/src/KLU/Include -I/g/g20/jjellio/src/github/Trilinos-a/packages/common/auxiliarySoftware/SuiteSparse/src/UFconfig -I/g/g20/jjellio/src/github/Trilinos-a -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/amesos2/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/amesos2/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/amesos2/src/KLU2/Include -I/g/g20/jjellio/src/github/Trilinos-a/packages/amesos2/src/KLU2/Source -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/shylu/shylu_node/tacho/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/shylu/shylu_node/tacho/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/shylu/shylu_node/tacho/src/impl -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/belos/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/belos/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/aztecoo/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/aztecoo/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/belos/epetra/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/belos/epetra/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/belos/tpetra/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/belos/tpetra/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/belos/xpetra/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/belos/xpetra/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/teko/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/teko/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/teko/src/NS -I/g/g20/jjellio/src/github/Trilinos-a/packages/teko/src/Epetra -I/g/g20/jjellio/src/github/Trilinos-a/packages/teko/src/Tpetra -I/g/g20/jjellio/src/github/Trilinos-a/packages/stratimikos/adapters/ifpack/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/ifpack/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/ifpack/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/ml/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/ml/src/Include -I/g/g20/jjellio/src/github/Trilinos-a/packages/ml/src/Comm -I/g/g20/jjellio/src/github/Trilinos-a/packages/ml/src/Coarsen -I/g/g20/jjellio/src/github/Trilinos-a/packages/ml/src/FEGrid -I/g/g20/jjellio/src/github/Trilinos-a/packages/ml/src/Main -I/g/g20/jjellio/src/github/Trilinos-a/packages/ml/src/Smoother -I/g/g20/jjellio/src/github/Trilinos-a/packages/ml/src/Krylov -I/g/g20/jjellio/src/github/Trilinos-a/packages/ml/src/Operator -I/g/g20/jjellio/src/github/Trilinos-a/packages/ml/src/Utils -I/g/g20/jjellio/src/github/Trilinos-a/packages/ml/src/RefMaxwell -I/g/g20/jjellio/src/github/Trilinos-a/packages/ml/src/MatrixFree -I/g/g20/jjellio/src/github/Trilinos-a/packages/ml/src/MLAPI -I/g/g20/jjellio/src/github/Trilinos-a/packages/ml/src/LevelWrap -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/zoltan/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/include -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/all -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/coloring -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/graph -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/ha -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/hier -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/hsfc -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/lb -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/matrix -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/order -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/par -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/params -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/tpls -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/phg -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/rcb -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/reftree -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/simple -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/timer -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/Utilities/Communication -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/Utilities/DDirectory -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/Utilities/Timer -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/Utilities/shared -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/zz -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/galeri/src-epetra -I/g/g20/jjellio/src/github/Trilinos-a/packages/galeri/src-epetra -I/g/g20/jjellio/src/github/Trilinos-a/packages/galeri/src-epetra/Maps -I/g/g20/jjellio/src/github/Trilinos-a/packages/galeri/src-epetra/CRSMatrices -I/g/g20/jjellio/src/github/Trilinos-a/packages/galeri/src-epetra/FiniteElements -I/g/g20/jjellio/src/github/Trilinos-a/packages/galeri/src-xpetra -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/galeri/src-xpetra -I/g/g20/jjellio/src/github/Trilinos-a/packages/galeri/src-xpetra/../src-epetra -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/galeri/src-xpetra/../src-epetra -I/g/g20/jjellio/src/github/Trilinos-a/packages/galeri/src-xpetra/../src/Utils -I/g/g20/jjellio/src/github/Trilinos-a/packages/galeri/src-xpetra/../src/Headers -I/g/g20/jjellio/src/github/Trilinos-a/packages/stratimikos/adapters/ml/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/stratimikos/adapters/amesos/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/stratimikos/adapters/aztecoo/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/stratimikos/adapters/amesos2/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/stratimikos/adapters/amesos2/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/stratimikos/adapters/belos/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/stratimikos/adapters/belos/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/stratimikos/adapters/belos/src/../../../src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/stratimikos/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/stratimikos/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/anasazi/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/anasazi/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/anasazi/src/../thyra/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/anasazi/src/../tpetra/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/anasazi/epetra/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/anasazi/epetra/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/anasazi/epetra/util/ModeLaplace -I/g/g20/jjellio/src/github/Trilinos-a/packages/anasazi/epetra/util/ModeLaplace -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/anasazi/tpetra/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/anasazi/tpetra/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/ifpack2/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/ifpack2/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/zoltan2/core/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/algorithms -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/algorithms/partition -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/algorithms/order -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/algorithms/color -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/algorithms/match -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/algorithms/map -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/algorithms/zoltan -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/environment -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/include -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/input -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/models -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/problems -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/TpetraCrsColorer -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/util -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/directory -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/shylu/shylu_node/hts/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/shylu/shylu_node/hts/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/ifpack2/adapters/thyra -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/ifpack2/adapters -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/intrepid2/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/intrepid2/src/Cell -I/g/g20/jjellio/src/github/Trilinos-a/packages/intrepid2/src/Discretization/Basis -I/g/g20/jjellio/src/github/Trilinos-a/packages/intrepid2/src/Discretization/FunctionSpaceTools -I/g/g20/jjellio/src/github/Trilinos-a/packages/intrepid2/src/Discretization/Integration -I/g/g20/jjellio/src/github/Trilinos-a/packages/intrepid2/src/Orientation -I/g/g20/jjellio/src/github/Trilinos-a/packages/intrepid2/src/Projection -I/g/g20/jjellio/src/github/Trilinos-a/packages/intrepid2/src/Shared -I/g/g20/jjellio/src/github/Trilinos-a/packages/intrepid2/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/shards/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/shards/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/sacado/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/sacado/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/sacado/src/new_design -I/g/g20/jjellio/src/github/Trilinos-a/packages/sacado/src/template -I/g/g20/jjellio/src/github/Trilinos-a/packages/sacado/src/parameter -I/g/g20/jjellio/src/github/Trilinos-a/packages/sacado/src/mpl -isystem /p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/boost-1.79.0-tnsjrvavksgzemju6s4gbptglnwoo4ye/include -isystem /opt/cray/pe/libsci/22.08.1.1/CRAY/9.0/x86_64/include -isystem /p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/metis-5.1.0-fpif6qy3otttnm26lzbqvkqwjnzgrw6b/include -isystem /p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/hdf5-1.10.7-4muxy5a2pluisnyl6viqey45adgmoyso/include -isystem /p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/superlu-dist-6.4.0-ykwgds7uru2x3ehhxqxbfea5q5m6ieiy/include -isystem /p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/parmetis-4.0.3-jpgzminxnku2kjev6oh3u5wj5yh4wdmz/include --offload-arch=gfx90a --rocm-path=/opt/rocm-5.2.0 -x hip -mllvm -amdgpu-early-inline-all=true -mllvm -amdgpu-function-calls=false -I/opt/cray/pe/mpich/8.1.18/ofi/crayclang/10.0/include -I/opt/rocm-5.2.0/include -g -march=znver3 -mtune=znver3 -fno-gpu-rdc -O3 -DNDEBUG -fPIC -std=c++14 -MD -MT packages/muelu/src/CMakeFiles/muelu.dir/Utils/ExplicitInstantiation/MueLu_RegionRFactory_kokkos.cpp.o -MF packages/muelu/src/CMakeFiles/muelu.dir/Utils/ExplicitInstantiation/MueLu_RegionRFactory_kokkos.cpp.o.d -o packages/muelu/src/CMakeFiles/muelu.dir/Utils/ExplicitInstantiation/MueLu_RegionRFactory_kokkos.cpp.o -c /tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/muelu/src/Utils/ExplicitInstantiation/MueLu_RegionRFactory_kokkos.cpp In file included from /tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/muelu/src/Utils/ExplicitInstantiation/MueLu_RegionRFactory_kokkos.cpp:55: /g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/GeneralGeometric/MueLu_RegionRFactory_kokkos_def.hpp:914:81: error: reference to __host__ function 'operator=' in __host__ __device__ function values(entryOffset + k*25 + j*5 + i + faceStencilLength*l) = coeffs_d[k + 2]*coeffs_d[j]*coeffs_d[i]; ^ /g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/HIP/Kokkos_HIP_Parallel_Range.hpp:82:5: note: called by 'exec_range' m_functor(i); ^ /g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/HIP/Kokkos_HIP_Parallel_Range.hpp:104:22: note: called by 'operator()' this->template exec_range(iwork); ^ /g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/HIP/Kokkos_HIP_KernelLaunch.hpp:114:11: note: called by 'hip_parallel_launch_local_memory, Kokkos::Experimental::HIP>, 1024U, 1U>' driver->operator()(); ^ /g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/Kokkos_Complex.hpp:146:12: note: 'operator=' declared here complex& operator=(const std::complex& src) noexcept { ^ In file included from /tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/muelu/src/Utils/ExplicitInstantiation/MueLu_RegionRFactory_kokkos.cpp:55: /g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/GeneralGeometric/MueLu_RegionRFactory_kokkos_def.hpp:939:81: error: reference to __host__ function 'operator=' in __host__ __device__ function values(entryOffset + k*25 + j*5 + i + faceStencilLength*l) = coeffs_d[k]*coeffs_d[j]*coeffs_d[i]; ^ /g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/Kokkos_Complex.hpp:146:12: note: 'operator=' declared here complex& operator=(const std::complex& src) noexcept { ^ In file included from /tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/muelu/src/Utils/ExplicitInstantiation/MueLu_RegionRFactory_kokkos.cpp:55: /g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/GeneralGeometric/MueLu_RegionRFactory_kokkos_def.hpp:988:81: error: reference to __host__ function 'operator=' in __host__ __device__ function values(entryOffset + k*15 + j*5 + i + faceStencilLength*l) = coeffs_d[k]*coeffs_d[j + 2]*coeffs_d[i]; ^ /g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/HIP/Kokkos_HIP_Parallel_Range.hpp:82:5: note: called by 'exec_range' m_functor(i); ^ /g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/HIP/Kokkos_HIP_Parallel_Range.hpp:104:22: note: called by 'operator()' this->template exec_range(iwork); ^ /g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/HIP/Kokkos_HIP_KernelLaunch.hpp:114:11: note: called by 'hip_parallel_launch_local_memory, Kokkos::Experimental::HIP>, 1024U, 1U>' driver->operator()(); ^ /g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/Kokkos_Complex.hpp:146:12: note: 'operator=' declared here complex& operator=(const std::complex& src) noexcept { ^ In file included from /tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/muelu/src/Utils/ExplicitInstantiation/MueLu_RegionRFactory_kokkos.cpp:55: /g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/GeneralGeometric/MueLu_RegionRFactory_kokkos_def.hpp:1013:81: error: reference to __host__ function 'operator=' in __host__ __device__ function values(entryOffset + k*15 + j*5 + i + faceStencilLength*l) = coeffs_d[k]*coeffs_d[j]*coeffs_d[i]; ^ /g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/Kokkos_Complex.hpp:146:12: note: 'operator=' declared here complex& operator=(const std::complex& src) noexcept { ^ In file included from /tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/muelu/src/Utils/ExplicitInstantiation/MueLu_RegionRFactory_kokkos.cpp:55: /g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/GeneralGeometric/MueLu_RegionRFactory_kokkos_def.hpp:1063:81: error: reference to __host__ function 'operator=' in __host__ __device__ function values(entryOffset + k*15 + j*3 + i + faceStencilLength*l) = coeffs_d[k]*coeffs_d[j]*coeffs_d[i + 2]; ^ /g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/HIP/Kokkos_HIP_Parallel_Range.hpp:82:5: note: called by 'exec_range' m_functor(i); ^ /g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/HIP/Kokkos_HIP_Parallel_Range.hpp:104:22: note: called by 'operator()' this->template exec_range(iwork); ^ /g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/HIP/Kokkos_HIP_KernelLaunch.hpp:114:11: note: called by 'hip_parallel_launch_local_memory, Kokkos::Experimental::HIP>, 1024U, 1U>' driver->operator()(); ^ /g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/Kokkos_Complex.hpp:146:12: note: 'operator=' declared here complex& operator=(const std::complex& src) noexcept { ^ In file included from /tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/muelu/src/Utils/ExplicitInstantiation/MueLu_RegionRFactory_kokkos.cpp:55: /g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/GeneralGeometric/MueLu_RegionRFactory_kokkos_def.hpp:1088:81: error: reference to __host__ function 'operator=' in __host__ __device__ function values(entryOffset + k*15 + j*3 + i + faceStencilLength*l) = coeffs_d[k]*coeffs_d[j]*coeffs_d[i]; ^ /g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/Kokkos_Complex.hpp:146:12: note: 'operator=' declared here complex& operator=(const std::complex& src) noexcept { ^ In file included from /tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/muelu/src/Utils/ExplicitInstantiation/MueLu_RegionRFactory_kokkos.cpp:55: /g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/GeneralGeometric/MueLu_RegionRFactory_kokkos_def.hpp:1178:74: error: reference to __host__ function 'operator=' in __host__ __device__ function values(entryOffset + entryIdx + interiorStencilLength*l) = interiorValues_d(entryIdx); ^ /g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/HIP/Kokkos_HIP_Parallel_Range.hpp:82:5: note: called by 'exec_range' m_functor(i); ^ /g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/HIP/Kokkos_HIP_Parallel_Range.hpp:104:22: note: called by 'operator()' this->template exec_range(iwork); ^ /g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/HIP/Kokkos_HIP_KernelLaunch.hpp:114:11: note: called by 'hip_parallel_launch_local_memory, Kokkos::Experimental::HIP>, 1024U, 1U>' driver->operator()(); ^ /g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/Kokkos_Complex.hpp:146:12: note: 'operator=' declared here complex& operator=(const std::complex& src) noexcept { ^ 7 errors generated when compiling for gfx90a. ```

Sorry none of this is handy right now! But I can get details. See discussion for CMake lines and Cache.txt

Steps to Reproduce

  1. SHA1: [insert here]
  2. Configure script: [attach here]
  3. Configure log: [attach here]
  4. Build log: [attach here]
  5. Input deck: [attach here]
  6. Do this.
  7. Do that.
  8. Shake fist angrily at computer.
  9. Run log: [attach here]
cgcgcg commented 2 years ago

I think this should be fixed by #11001. (It was an easy fix, so I dumped that commit into another PR.)

jjellio commented 2 years ago

I'll try merging it later - and post back!

jjellio commented 2 years ago

My connection to the remote machine tanked mid build, so I don't know if the reported target finished or not.... but I have a new target that failed

This is with a develop pull about 2 hours ago, then I merged your branch ontop of that.

[4598/5380] Building CXX object packages/muelu/src/CMakeFiles/muelu.dir/Utils/ExplicitInstantiation/MueLu_RegionRFactory_kokkos.cpp.o
FAILED: packages/muelu/src/CMakeFiles/muelu.dir/Utils/ExplicitInstantiation/MueLu_RegionRFactory_kokkos.cpp.o 
/opt/rocm-5.2.0/bin/amdclang++ -Dmuelu_EXPORTS -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Graph -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Graph/BrickAggregation -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Graph/Containers -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Graph/CoupledAggregation -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Graph/HybridAggregation -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Graph/MatrixTransformation -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Graph/PairwiseAggregation -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Graph/StructuredAggregation -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Graph/StructuredAggregation/coupled -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Graph/StructuredAggregation/uncoupled -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Graph/UncoupledAggregation -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Graph/UserAggregation -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Headers -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Interface -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Interface/FacadeClasses -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Misc -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/MueCentral -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Rebalancing -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Smoothers -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/BaseClass -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/BlackBox -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Smoothers/BlockedSmoothers -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/BlockedTransfers -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/Classical -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/Energy-Minimization -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/Energy-Minimization/Solvers -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/GeneralGeometric -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/Generic -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/Geometric-Interpolation -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/Petrov-Galerkin-SA -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/SemiCoarsen -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/Smoothed-Aggregation -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/User -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Utils -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Utils/ForwardDeclaration -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/../adapters/xpetra -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/../adapters/tpetra -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/PCoarsen -I/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/../adapters/stratimikos -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/muelu/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/teuchos/core/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/teuchos/core/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/kokkos/core/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/kokkos -I/g/g20/jjellio/src/github/Trilinos-a/packages/teuchos/parser/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/teuchos/parameterlist/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/teuchos/comm/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/teuchos/numerics/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/teuchos/remainder/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/teuchos/remainder/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/teuchos/kokkoscompat/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/teuchos/kokkoscompat/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/teuchos/kokkoscomm/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/teuchos/kokkoscomm/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/CrsGraph -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/CrsMatrix -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/BlockedCrsMatrix -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/DistObject -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/Export -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/Headers -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/Import -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/Map -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/BlockedMap -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/MultiVector -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/BlockedMultiVector -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/BlockedVector -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/Operator -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/Platform -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/RowGraph -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/RowMatrix -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/Utils -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/Utils/ForwardDeclaration -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/src/Vector -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/xpetra/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/kokkos/containers/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/containers/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/tpetra/tsqr/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/tpetra/tsqr/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/kokkos-kernels/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src/impl -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/kokkos-kernels/src/impl -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src/impl/tpls -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src/blas -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src/blas/impl -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src/sparse -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src/sparse/impl -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src/graph -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src/graph/impl -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src/batched -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src/batched/dense -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src/batched/dense/impl -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src/batched/sparse -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src/batched/sparse/impl -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos-kernels/src/common -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/kokkos/algorithms/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/algorithms/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/tpetra/core/compat -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/tpetra/core/compat -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/epetra/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/epetra/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/tpetra/core/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/tpetra/core/src/kokkos_refactor -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/tpetra/core/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/tpetra/core/inout -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/tpetra/core/inout -I/g/g20/jjellio/src/github/Trilinos-a/packages/tpetra/core/ext -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/tpetra/core/ext -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/core/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/core/src/interfaces/operator_vector/fundamental -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/core/src/interfaces/operator_vector/extended -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/core/src/support/operator_vector/client_support -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/core/src/support/operator_vector/adapter_support -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/core/src/interfaces/operator_solve/fundamental -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/core/src/interfaces/operator_solve/extended -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/core/src/support/operator_solve/client_support -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/core/src/interfaces/nonlinear/model_evaluator/fundamental -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/core/src/support/nonlinear/model_evaluator/client_support -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/core/src/interfaces/nonlinear/solvers/fundamental -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/core/src/support/nonlinear/solvers/client_support -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/thyra/core/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/core/example/operator_vector -I/g/g20/jjellio/src/github/Trilinos-a/packages/rtop/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/rtop/src/interfaces -I/g/g20/jjellio/src/github/Trilinos-a/packages/rtop/src/support -I/g/g20/jjellio/src/github/Trilinos-a/packages/rtop/src/ops_lib -I/g/g20/jjellio/src/github/Trilinos-a/packages/rtop/src/lapack -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/rtop/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/adapters/epetra/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/adapters/epetraext/src/model_evaluator -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/adapters/epetraext/src/transformer -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/epetraext/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/epetraext/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/epetraext/src/transform -I/g/g20/jjellio/src/github/Trilinos-a/packages/epetraext/src/inout -I/g/g20/jjellio/src/github/Trilinos-a/packages/epetraext/src/coloring -I/g/g20/jjellio/src/github/Trilinos-a/packages/epetraext/src/model_evaluator -I/g/g20/jjellio/src/github/Trilinos-a/packages/epetraext/src/block -I/g/g20/jjellio/src/github/Trilinos-a/packages/epetraext/src/restrict -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/triutils/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/triutils/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/thyra/adapters/tpetra/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/sup/Matrix -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/sup/StridedMap -I/g/g20/jjellio/src/github/Trilinos-a/packages/xpetra/sup/Utils -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/xpetra/sup -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/amesos/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/amesos/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/common/auxiliarySoftware/SuiteSparse/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/common/auxiliarySoftware/SuiteSparse/src/AMD/Include -I/g/g20/jjellio/src/github/Trilinos-a/packages/common/auxiliarySoftware/SuiteSparse/src/BTF/Include -I/g/g20/jjellio/src/github/Trilinos-a/packages/common/auxiliarySoftware/SuiteSparse/src/CAMD/Include -I/g/g20/jjellio/src/github/Trilinos-a/packages/common/auxiliarySoftware/SuiteSparse/src/CCOLAMD/Include -I/g/g20/jjellio/src/github/Trilinos-a/packages/common/auxiliarySoftware/SuiteSparse/src/COLAMD/Include -I/g/g20/jjellio/src/github/Trilinos-a/packages/common/auxiliarySoftware/SuiteSparse/src/KLU/Include -I/g/g20/jjellio/src/github/Trilinos-a/packages/common/auxiliarySoftware/SuiteSparse/src/UFconfig -I/g/g20/jjellio/src/github/Trilinos-a -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/amesos2/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/amesos2/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/amesos2/src/KLU2/Include -I/g/g20/jjellio/src/github/Trilinos-a/packages/amesos2/src/KLU2/Source -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/shylu/shylu_node/tacho/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/shylu/shylu_node/tacho/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/shylu/shylu_node/tacho/src/impl -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/belos/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/belos/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/aztecoo/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/aztecoo/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/belos/epetra/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/belos/epetra/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/belos/tpetra/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/belos/tpetra/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/belos/xpetra/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/belos/xpetra/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/teko/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/teko/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/teko/src/NS -I/g/g20/jjellio/src/github/Trilinos-a/packages/teko/src/Epetra -I/g/g20/jjellio/src/github/Trilinos-a/packages/teko/src/Tpetra -I/g/g20/jjellio/src/github/Trilinos-a/packages/stratimikos/adapters/ifpack/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/ifpack/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/ifpack/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/ml/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/ml/src/Include -I/g/g20/jjellio/src/github/Trilinos-a/packages/ml/src/Comm -I/g/g20/jjellio/src/github/Trilinos-a/packages/ml/src/Coarsen -I/g/g20/jjellio/src/github/Trilinos-a/packages/ml/src/FEGrid -I/g/g20/jjellio/src/github/Trilinos-a/packages/ml/src/Main -I/g/g20/jjellio/src/github/Trilinos-a/packages/ml/src/Smoother -I/g/g20/jjellio/src/github/Trilinos-a/packages/ml/src/Krylov -I/g/g20/jjellio/src/github/Trilinos-a/packages/ml/src/Operator -I/g/g20/jjellio/src/github/Trilinos-a/packages/ml/src/Utils -I/g/g20/jjellio/src/github/Trilinos-a/packages/ml/src/RefMaxwell -I/g/g20/jjellio/src/github/Trilinos-a/packages/ml/src/MatrixFree -I/g/g20/jjellio/src/github/Trilinos-a/packages/ml/src/MLAPI -I/g/g20/jjellio/src/github/Trilinos-a/packages/ml/src/LevelWrap -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/zoltan/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/include -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/all -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/coloring -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/graph -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/ha -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/hier -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/hsfc -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/lb -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/matrix -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/order -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/par -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/params -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/tpls -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/phg -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/rcb -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/reftree -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/simple -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/timer -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/Utilities/Communication -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/Utilities/DDirectory -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/Utilities/Timer -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/Utilities/shared -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan/src/zz -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/galeri/src-epetra -I/g/g20/jjellio/src/github/Trilinos-a/packages/galeri/src-epetra -I/g/g20/jjellio/src/github/Trilinos-a/packages/galeri/src-epetra/Maps -I/g/g20/jjellio/src/github/Trilinos-a/packages/galeri/src-epetra/CRSMatrices -I/g/g20/jjellio/src/github/Trilinos-a/packages/galeri/src-epetra/FiniteElements -I/g/g20/jjellio/src/github/Trilinos-a/packages/galeri/src-xpetra -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/galeri/src-xpetra -I/g/g20/jjellio/src/github/Trilinos-a/packages/galeri/src-xpetra/../src-epetra -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/galeri/src-xpetra/../src-epetra -I/g/g20/jjellio/src/github/Trilinos-a/packages/galeri/src-xpetra/../src/Utils -I/g/g20/jjellio/src/github/Trilinos-a/packages/galeri/src-xpetra/../src/Headers -I/g/g20/jjellio/src/github/Trilinos-a/packages/stratimikos/adapters/ml/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/stratimikos/adapters/amesos/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/stratimikos/adapters/aztecoo/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/stratimikos/adapters/amesos2/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/stratimikos/adapters/amesos2/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/stratimikos/adapters/belos/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/stratimikos/adapters/belos/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/stratimikos/adapters/belos/src/../../../src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/stratimikos/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/stratimikos/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/anasazi/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/anasazi/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/anasazi/src/../thyra/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/anasazi/src/../tpetra/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/anasazi/epetra/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/anasazi/epetra/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/anasazi/epetra/util/ModeLaplace -I/g/g20/jjellio/src/github/Trilinos-a/packages/anasazi/epetra/util/ModeLaplace -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/anasazi/tpetra/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/anasazi/tpetra/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/ifpack2/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/ifpack2/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/zoltan2/core/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/algorithms -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/algorithms/partition -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/algorithms/order -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/algorithms/color -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/algorithms/match -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/algorithms/map -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/algorithms/zoltan -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/environment -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/include -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/input -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/models -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/problems -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/TpetraCrsColorer -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/util -I/g/g20/jjellio/src/github/Trilinos-a/packages/zoltan2/core/src/directory -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/shylu/shylu_node/hts/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/shylu/shylu_node/hts/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/ifpack2/adapters/thyra -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/ifpack2/adapters -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/intrepid2/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/intrepid2/src/Cell -I/g/g20/jjellio/src/github/Trilinos-a/packages/intrepid2/src/Discretization/Basis -I/g/g20/jjellio/src/github/Trilinos-a/packages/intrepid2/src/Discretization/FunctionSpaceTools -I/g/g20/jjellio/src/github/Trilinos-a/packages/intrepid2/src/Discretization/Integration -I/g/g20/jjellio/src/github/Trilinos-a/packages/intrepid2/src/Orientation -I/g/g20/jjellio/src/github/Trilinos-a/packages/intrepid2/src/Projection -I/g/g20/jjellio/src/github/Trilinos-a/packages/intrepid2/src/Shared -I/g/g20/jjellio/src/github/Trilinos-a/packages/intrepid2/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/shards/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/shards/src -I/tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/sacado/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/sacado/src -I/g/g20/jjellio/src/github/Trilinos-a/packages/sacado/src/new_design -I/g/g20/jjellio/src/github/Trilinos-a/packages/sacado/src/template -I/g/g20/jjellio/src/github/Trilinos-a/packages/sacado/src/parameter -I/g/g20/jjellio/src/github/Trilinos-a/packages/sacado/src/mpl -isystem /p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/boost-1.79.0-tnsjrvavksgzemju6s4gbptglnwoo4ye/include -isystem /opt/cray/pe/libsci/22.08.1.1/CRAY/9.0/x86_64/include -isystem /p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/metis-5.1.0-fpif6qy3otttnm26lzbqvkqwjnzgrw6b/include -isystem /p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/hdf5-1.10.7-4muxy5a2pluisnyl6viqey45adgmoyso/include -isystem /p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/superlu-dist-6.4.0-ykwgds7uru2x3ehhxqxbfea5q5m6ieiy/include -isystem /p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/parmetis-4.0.3-jpgzminxnku2kjev6oh3u5wj5yh4wdmz/include --offload-arch=gfx90a --rocm-path=/opt/rocm-5.2.0 -x hip -mllvm -amdgpu-early-inline-all=true -mllvm -amdgpu-function-calls=false -I/opt/cray/pe/mpich/8.1.18/ofi/crayclang/10.0/include -I/opt/rocm-5.2.0/include -g -march=znver3 -mtune=znver3 -fno-gpu-rdc  -O3 -DNDEBUG -fPIC -std=c++14 -MD -MT packages/muelu/src/CMakeFiles/muelu.dir/Utils/ExplicitInstantiation/MueLu_RegionRFactory_kokkos.cpp.o -MF packages/muelu/src/CMakeFiles/muelu.dir/Utils/ExplicitInstantiation/MueLu_RegionRFactory_kokkos.cpp.o.d -o packages/muelu/src/CMakeFiles/muelu.dir/Utils/ExplicitInstantiation/MueLu_RegionRFactory_kokkos.cpp.o -c /tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/muelu/src/Utils/ExplicitInstantiation/MueLu_RegionRFactory_kokkos.cpp
In file included from /tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/muelu/src/Utils/ExplicitInstantiation/MueLu_RegionRFactory_kokkos.cpp:55:
/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/GeneralGeometric/MueLu_RegionRFactory_kokkos_def.hpp:914:81: error: reference to __host__ function 'operator=' in __host__ __device__ function
                    values(entryOffset + k*25 + j*5 + i + faceStencilLength*l)  = coeffs_d[k + 2]*coeffs_d[j]*coeffs_d[i];
                                                                                ^
/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/HIP/Kokkos_HIP_Parallel_Range.hpp:82:5: note: called by 'exec_range<void>'
    m_functor(i);
    ^
/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/HIP/Kokkos_HIP_Parallel_Range.hpp:104:22: note: called by 'operator()'
      this->template exec_range<WorkTag>(iwork);
                     ^
/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/HIP/Kokkos_HIP_KernelLaunch.hpp:114:11: note: called by 'hip_parallel_launch_local_memory<Kokkos::Impl::ParallelFor<(lambda at /g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/GeneralGeometric/MueLu_RegionRFactory_kokkos_def.hpp:886:9), Kokkos::RangePolicy<Kokkos::Experimental::HIP>, Kokkos::Experimental::HIP>, 1024U, 1U>'
  driver->operator()();
          ^
/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/Kokkos_Complex.hpp:146:12: note: 'operator=' declared here
  complex& operator=(const std::complex<RealType>& src) noexcept {
           ^
In file included from /tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/muelu/src/Utils/ExplicitInstantiation/MueLu_RegionRFactory_kokkos.cpp:55:
/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/GeneralGeometric/MueLu_RegionRFactory_kokkos_def.hpp:939:81: error: reference to __host__ function 'operator=' in __host__ __device__ function
                    values(entryOffset + k*25 + j*5 + i + faceStencilLength*l)  = coeffs_d[k]*coeffs_d[j]*coeffs_d[i];
                                                                                ^
/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/Kokkos_Complex.hpp:146:12: note: 'operator=' declared here
  complex& operator=(const std::complex<RealType>& src) noexcept {
           ^
In file included from /tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/muelu/src/Utils/ExplicitInstantiation/MueLu_RegionRFactory_kokkos.cpp:55:
/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/GeneralGeometric/MueLu_RegionRFactory_kokkos_def.hpp:988:81: error: reference to __host__ function 'operator=' in __host__ __device__ function
                    values(entryOffset + k*15 + j*5 + i + faceStencilLength*l)  = coeffs_d[k]*coeffs_d[j + 2]*coeffs_d[i];
                                                                                ^
/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/HIP/Kokkos_HIP_Parallel_Range.hpp:82:5: note: called by 'exec_range<void>'
    m_functor(i);
    ^
/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/HIP/Kokkos_HIP_Parallel_Range.hpp:104:22: note: called by 'operator()'
      this->template exec_range<WorkTag>(iwork);
                     ^
/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/HIP/Kokkos_HIP_KernelLaunch.hpp:114:11: note: called by 'hip_parallel_launch_local_memory<Kokkos::Impl::ParallelFor<(lambda at /g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/GeneralGeometric/MueLu_RegionRFactory_kokkos_def.hpp:959:9), Kokkos::RangePolicy<Kokkos::Experimental::HIP>, Kokkos::Experimental::HIP>, 1024U, 1U>'
  driver->operator()();
          ^
/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/Kokkos_Complex.hpp:146:12: note: 'operator=' declared here
  complex& operator=(const std::complex<RealType>& src) noexcept {
           ^
In file included from /tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/muelu/src/Utils/ExplicitInstantiation/MueLu_RegionRFactory_kokkos.cpp:55:
/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/GeneralGeometric/MueLu_RegionRFactory_kokkos_def.hpp:1013:81: error: reference to __host__ function 'operator=' in __host__ __device__ function
                    values(entryOffset + k*15 + j*5 + i + faceStencilLength*l)  = coeffs_d[k]*coeffs_d[j]*coeffs_d[i];
                                                                                ^
/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/Kokkos_Complex.hpp:146:12: note: 'operator=' declared here
  complex& operator=(const std::complex<RealType>& src) noexcept {
           ^
In file included from /tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/muelu/src/Utils/ExplicitInstantiation/MueLu_RegionRFactory_kokkos.cpp:55:
/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/GeneralGeometric/MueLu_RegionRFactory_kokkos_def.hpp:1063:81: error: reference to __host__ function 'operator=' in __host__ __device__ function
                    values(entryOffset + k*15 + j*3 + i + faceStencilLength*l)  = coeffs_d[k]*coeffs_d[j]*coeffs_d[i + 2];
                                                                                ^
/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/HIP/Kokkos_HIP_Parallel_Range.hpp:82:5: note: called by 'exec_range<void>'
    m_functor(i);
    ^
/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/HIP/Kokkos_HIP_Parallel_Range.hpp:104:22: note: called by 'operator()'
      this->template exec_range<WorkTag>(iwork);
                     ^
/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/HIP/Kokkos_HIP_KernelLaunch.hpp:114:11: note: called by 'hip_parallel_launch_local_memory<Kokkos::Impl::ParallelFor<(lambda at /g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/GeneralGeometric/MueLu_RegionRFactory_kokkos_def.hpp:1033:9), Kokkos::RangePolicy<Kokkos::Experimental::HIP>, Kokkos::Experimental::HIP>, 1024U, 1U>'
  driver->operator()();
          ^
/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/Kokkos_Complex.hpp:146:12: note: 'operator=' declared here
  complex& operator=(const std::complex<RealType>& src) noexcept {
           ^
In file included from /tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/muelu/src/Utils/ExplicitInstantiation/MueLu_RegionRFactory_kokkos.cpp:55:
/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/GeneralGeometric/MueLu_RegionRFactory_kokkos_def.hpp:1088:81: error: reference to __host__ function 'operator=' in __host__ __device__ function
                    values(entryOffset + k*15 + j*3 + i + faceStencilLength*l)  = coeffs_d[k]*coeffs_d[j]*coeffs_d[i];
                                                                                ^
/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/Kokkos_Complex.hpp:146:12: note: 'operator=' declared here
  complex& operator=(const std::complex<RealType>& src) noexcept {
           ^
In file included from /tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/packages/muelu/src/Utils/ExplicitInstantiation/MueLu_RegionRFactory_kokkos.cpp:55:
/g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/GeneralGeometric/MueLu_RegionRFactory_kokkos_def.hpp:1178:74: error: reference to __host__ function 'operator=' in __host__ __device__ function
                values(entryOffset + entryIdx + interiorStencilLength*l) = interiorValues_d(entryIdx);
                                                                         ^
/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/HIP/Kokkos_HIP_Parallel_Range.hpp:82:5: note: called by 'exec_range<void>'
    m_functor(i);
    ^
/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/HIP/Kokkos_HIP_Parallel_Range.hpp:104:22: note: called by 'operator()'
      this->template exec_range<WorkTag>(iwork);
                     ^
/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/HIP/Kokkos_HIP_KernelLaunch.hpp:114:11: note: called by 'hip_parallel_launch_local_memory<Kokkos::Impl::ParallelFor<(lambda at /g/g20/jjellio/src/github/Trilinos-a/packages/muelu/src/Transfers/GeneralGeometric/MueLu_RegionRFactory_kokkos_def.hpp:1140:9), Kokkos::RangePolicy<Kokkos::Experimental::HIP>, Kokkos::Experimental::HIP>, 1024U, 1U>'
  driver->operator()();
          ^
/g/g20/jjellio/src/github/Trilinos-a/packages/kokkos/core/src/Kokkos_Complex.hpp:146:12: note: 'operator=' declared here
  complex& operator=(const std::complex<RealType>& src) noexcept {
           ^
7 errors generated when compiling for gfx90a.
cgcgcg commented 2 years ago

Ah. You are building with MueLu_ENABLE_Experimental=On. Is that required?

jjellio commented 2 years ago

Nope, No MueLu specific flags, ENABLE_ALL_PACKAGES and a few disables. serial + HIP, and the usual SNL TPLs

I'm generating the CMake lines now. It's pretty much what Ross' ATDM builds do

Cmake ``` cmake \ "-GNinja" \ "-DCMAKE_BUILD_TYPE:STRING=Release" \ "-DTrilinos_ENABLE_TrilinosBuildStats=OFF" \ "-DTrilinos_ENABLE_BUILD_STATS=OFF" \ "-DTrilinosBuildStats_ENABLE_TESTS=OFF" \ "-DBUILD_SHARED_LIBS:BOOL=ON" \ "-DTrilinos_ENABLE_Teuchos=ON" \ "-DTrilinos_ENABLE_Percept=OFF" \ "-DTrilinos_ENABLE_ALL_PACKAGES=ON" \ "-DKokkos_ARCH_ZEN3:BOOL=ON" \ "-DKokkos_ENABLE_SERIAL:BOOL=ON" \ "-DTpetra_INST_SERIAL:BOOL=ON" \ "-DKokkos_ENABLE_OPENMP:BOOL=OFF" \ "-DTpetra_INST_OPENMP:BOOL=OFF" \ "-DTrilinos_ENABLE_OpenMP:BOOL=OFF" \ "-DKokkos_ENABLE_HIP:BOOL=ON" \ "-DTpetra_INST_HIP:BOOL=ON" \ "-DKokkos_ARCH_VEGA90A:BOOL=ON" \ "-DCMAKE_EXE_LINKER_FLAGS=-x none " \ "-DCMAKE_SHARED_LINKER_FLAGS=-x none" \ "-DCMAKE_LINKER=/opt/cray/pe/craype/2.7.17/bin/CC" \ "-DCMAKE_CXX_LINK_EXECUTABLE= -x none -hsystem_alloc -o " \ "-DCMAKE_CXX_CREATE_SHARED_LIBRARY= -x none -hsystem_alloc -o " \ "-DCMAKE_Fortran_LINK_EXECUTABLE= -x none -hsystem_alloc -o " \ "-DCMAKE_Fortran_CREATE_SHARED_LIBRARY= -hsystem_alloc -o " \ "-DCMAKE_CXX_COMPILER=/opt/rocm-5.2.0/bin/amdclang++" \ "-DCMAKE_C_COMPILER=/opt/cray/pe/craype/2.7.17/bin/cc" \ "-DCMAKE_Fortran_COMPILER=/opt/cray/pe/craype/2.7.17/bin/ftn" \ "-DCMAKE_CXX_FLAGS=--offload-arch=gfx90a --rocm-path=/opt/rocm-5.2.0 -x hip -mllvm -amdgpu-early-inline-all=true -mllvm -amdgpu-function-calls=false -I/opt/cray/pe/mpich/8.1.18/ofi/crayclang/10.0/include -I/opt/rocm-5.2.0/include -g " \ "-DCMAKE_Fortran_FLAGS=-I/opt/cray/pe/mpich/8.1.18/ofi/crayclang/10.0/include -I/opt/rocm-5.2.0/include -hsystem_alloc " \ "-DCMAKE_C_FLAGS=-I/opt/cray/pe/mpich/8.1.18/ofi/crayclang/10.0/include -I/opt/rocm-5.2.0/include " \ "-DTrilinos_EXTRA_LINK_FLAGS=-L/opt/rocm-5.2.0/lib -Wl,-rpath,/opt/rocm-5.2.0/lib -lamdhip64 -L/opt/cray/pe/mpich/8.1.18/ofi/crayclang/10.0/lib -Wl,-rpath,/opt/cray/pe/mpich/8.1.18/ofi/crayclang/10.0/lib -lmpi -L/opt/cray/pe/mpich/8.1.18/gtl/lib -Wl,-rpath,/opt/cray/pe/mpich/8.1.18/gtl/lib -lmpi_gtl_hsa " \ "-DTrilinos_ENABLE_Fortran:BOOL=ON" \ "-DTrilinos_ENABLE_TrilinosATDMConfigTests:BOOL=OFF" \ "-DTrilinos_ENABLE_TrilinosFrameworkTests=OFF" \ "-DTrilinos_ENABLE_MiniTensor=OFF" \ "-DTrilinos_ENABLE_Isorropia=OFF" \ "-DTrilinos_ENABLE_KokkosExample=OFF" \ "-DTrilinos_ENABLE_Domi=OFF" \ "-DTrilinos_ENABLE_Pliris=OFF" \ "-DTrilinos_ENABLE_Komplex=OFF" \ "-DTrilinos_ENABLE_FEI=OFF" \ "-DTrilinos_ENABLE_TriKota=OFF" \ "-DTrilinos_ENABLE_Compadre=OFF" \ "-DTrilinos_ENABLE_STKClassic=OFF" \ "-DTrilinos_ENABLE_STKSearchUtil=OFF" \ "-DTrilinos_ENABLE_STKUnit_tests=OFF" \ "-DTrilinos_ENABLE_STKDoc_tests=OFF" \ "-DTrilinos_ENABLE_STKExp=OFF" \ "-DTrilinos_ENABLE_Moertel=OFF" \ "-DTrilinos_ENABLE_Stokhos=OFF" \ "-DTrilinos_ENABLE_MOOCHO=OFF" \ "-DTrilinos_ENABLE_PyTrilinos=OFF" \ "-DTrilinos_ENABLE_TrilinosCouplings=OFF" \ "-DTrilinos_ENABLE_Pike=OFF" \ "-DShyLU_DD_ENABLE_BDDC=OFF" \ "-DTrilinos_ENABLE_PyTrilinos=OFF" \ "-DKOKKOSKERNELS_TPL_BLAS_RETURN_COMPLEX=OFF" \ "-DTacho_ENABLE_INT_INT:BOOL=ON" \ "-DTrilinos_ENABLE_COMPLEX_DOUBLE:BOOL=ON" \ "-DTPL_ENABLE_BinUtils:BOOL=OFF" \ "-DBinUtils_INCLUDE_DIRS=/p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/binutils-2.38-qtwpwyu4a23d5534lgbjyw6zwmorh44b/include" \ "-DBinUtils_LIBRARY_DIRS=/p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/binutils-2.38-qtwpwyu4a23d5534lgbjyw6zwmorh44b/lib" \ "-DTPL_ENABLE_BLAS:BOOL=ON" \ "-DTPL_ENABLE_LAPACK:BOOL=ON" \ "-DBLAS_LIBRARY_NAMES=sci_cray" \ "-DBLAS_INCLUDE_DIRS=/opt/cray/pe/libsci/22.08.1.1/CRAY/9.0/x86_64/include" \ "-DBLAS_LIBRARY_DIRS=/opt/cray/pe/libsci/22.08.1.1/CRAY/9.0/x86_64/lib" \ "-DLAPACK_LIBRARY_NAMES=sci_cray" \ "-DLAPACK_INCLUDE_DIRS=/opt/cray/pe/libsci/22.08.1.1/CRAY/9.0/x86_64/include" \ "-DLAPACK_LIBRARY_DIRS=/opt/cray/pe/libsci/22.08.1.1/CRAY/9.0/x86_64/lib" \ "-DTPL_ENABLE_Boost:BOOL=ON" \ "-DTPL_ENABLE_BoostLib:BOOL=ON" \ "-DBoost_INCLUDE_DIRS=/p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/boost-1.79.0-tnsjrvavksgzemju6s4gbptglnwoo4ye/include" \ "-DBoost_LIBRARY_DIRS=/p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/boost-1.79.0-tnsjrvavksgzemju6s4gbptglnwoo4ye/lib" \ "-DBoostLib_INCLUDE_DIRS=/p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/boost-1.79.0-tnsjrvavksgzemju6s4gbptglnwoo4ye/include" \ "-DBoostLib_LIBRARY_DIRS=/p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/boost-1.79.0-tnsjrvavksgzemju6s4gbptglnwoo4ye/lib" \ "-DTPL_ENABLE_METIS:BOOL=ON" \ "-DTPL_ENABLE_ParMETIS:BOOL=ON" \ "-DTPL_METIS_INCLUDE_DIRS=/p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/metis-5.1.0-fpif6qy3otttnm26lzbqvkqwjnzgrw6b/include" \ "-DTPL_METIS_LIBRARY_DIRS=/p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/metis-5.1.0-fpif6qy3otttnm26lzbqvkqwjnzgrw6b/lib" \ "-DTPL_ParMETIS_INCLUDE_DIRS=/p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/parmetis-4.0.3-jpgzminxnku2kjev6oh3u5wj5yh4wdmz/include;/p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/metis-5.1.0-fpif6qy3otttnm26lzbqvkqwjnzgrw6b/include" \ "-DTPL_ParMETIS_LIBRARY_DIRS=/p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/parmetis-4.0.3-jpgzminxnku2kjev6oh3u5wj5yh4wdmz/lib;/p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/metis-5.1.0-fpif6qy3otttnm26lzbqvkqwjnzgrw6b/lib" \ "-DTPL_ENABLE_CGNS:BOOL=ON" \ "-DCGNS_INCLUDE_DIRS=/p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/cgns-4.3.0-y5srwcogbr45zyvosxb2o4t3h7ejr4mp/include" \ "-DCGNS_LIBRARY_DIRS=/p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/cgns-4.3.0-y5srwcogbr45zyvosxb2o4t3h7ejr4mp/lib" \ "-DTPL_ENABLE_HDF5:BOOL=ON" \ "-DHDF5_LIBRARY_DIRS=/p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/hdf5-1.10.7-4muxy5a2pluisnyl6viqey45adgmoyso/lib;/p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/zlib-1.2.12-7rdn5lyw7s67v4ofde5xwfakbrnkuvvo/lib" \ "-DHDF5_INCLUDE_DIRS=/p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/hdf5-1.10.7-4muxy5a2pluisnyl6viqey45adgmoyso/include" \ "-DHDF5_LIBRARY_NAMES=hdf5_hl;hdf5;z;dl" \ "-DTPL_ENABLE_Netcdf:BOOL=ON" \ "-DNetcdf_LIBRARY_DIRS=/p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/zlib-1.2.12-7rdn5lyw7s67v4ofde5xwfakbrnkuvvo/lib;/p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/boost-1.79.0-tnsjrvavksgzemju6s4gbptglnwoo4ye/lib;/p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/netcdf-c-4.8.1-3tiq2lvtmgjpu5yzlhz4dslij3whlqct/lib;/p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/parallel-netcdf-1.12.2-nuvpwpf4tiljvo366c3jmmcsa27fvarm/lib;/p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/hdf5-1.10.7-4muxy5a2pluisnyl6viqey45adgmoyso/lib;/p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/libzip-1.2.0-bhasbkz5ba6gpqfhgijr3yxefpdkh6nz/lib" \ "-DNetcdf_LIBRARY_NAMES=netcdf;pnetcdf;z;zip;hdf5_hl;hdf5" \ "-DNetcdf_INCLUDE_DIRS=/p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/netcdf-c-4.8.1-3tiq2lvtmgjpu5yzlhz4dslij3whlqct/include;/p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/parallel-netcdf-1.12.2-nuvpwpf4tiljvo366c3jmmcsa27fvarm/include" \ "-DTPL_ENABLE_SuperLUDist:BOOL=ON" \ "-DSuperLUDist_INCLUDE_DIRS=/p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/superlu-dist-6.4.0-ykwgds7uru2x3ehhxqxbfea5q5m6ieiy/include" \ "-DSuperLUDist_LIBRARY_DIRS=/p/lustre1/jjellio/spack/install/cray-rhel8-zen3/cce-14.0.0/superlu-dist-6.4.0-ykwgds7uru2x3ehhxqxbfea5q5m6ieiy/lib" \ "-DTPL_ENABLE_MPI:BOOL=ON" \ "-DMPI_USE_COMPILER_WRAPPERS=OFF" \ "-DMPI_EXEC_NUMPROCS_FLAG=--srun_clean;--srun_pause=1;--mpibind=off;--exclusive;-c8;--gpus-per-task=1;-n" \ "-DMPI_EXEC=/p/lustre1/jjellio/spack/srun_wrap" \ "-DTPL_ENABLE_DLlib:BOOL=ON" \ "-DDLlib_INCLUDE_DIRS=/opt/rocm-5.2.0/include" \ "-DDLlib_LIBRARY_DIRS=/opt/rocm-5.2.0/lib" \ "-DDLlib_LIBRARY_NAMES=dl;hipsolver;rocsolver;hipblas;rocblas;hipsparse;rocsparse;amd_comgr;hsa-runtime64;amdhip64" \ "-DTPL_ENABLE_Matio=OFF" \ "-DTPL_ENABLE_X11=OFF" \ ```
jjellio commented 2 years ago

Here is what got set in the CMake Cache

CMakeCache.txt ``` [jjellio@rzvernal12 20:42 src]$ grep ^MueLu /tmp/jjellio/build/cce-14.0.2_prgenv-cray_rocm-5.2.0_mpich-8.1.18_hip_amd-inlall-NOfunc-gfx90a_serial_atdm_complex_opt-g_libonly/trilinos/CMakeCache.txt MueLu_DISABLE_STRONG_WARNINGS:BOOL=OFF MueLu_ENABLE_ADDITIVE_VARIANT:BOOL=NO MueLu_ENABLE_Boost_for_real:BOOL=OFF MueLu_ENABLE_DEBUG:BOOL=OFF MueLu_ENABLE_DEPRECATED_CODE:BOOL=YES MueLu_ENABLE_DEPRECATED_TESTS:BOOL=NO MueLu_ENABLE_EXAMPLES:STRING= MueLu_ENABLE_EXPLICIT_INSTANTIATION:BOOL=ON MueLu_ENABLE_Experimental:BOOL=NO MueLu_ENABLE_GOOGLE_PERFTOOLS:BOOL=OFF MueLu_ENABLE_Kokkos_Refactor:BOOL=ON MueLu_ENABLE_ML_MMM:BOOL=OFF MueLu_ENABLE_PROFILING:BOOL=OFF MueLu_ENABLE_REGION_SPLITTING:BOOL=NO MueLu_ENABLE_SPLIT_ETI_CPP_FILES:BOOL=NO MueLu_ENABLE_TESTS:STRING= MueLu_ENABLE_Tutorial:BOOL=MueLu_ENABLE_Tutorial_DEFAULT MueLu_HIDE_DEPRECATED_CODE:BOOL=OFF MueLu_SHOW_DEPRECATED_WARNINGS:BOOL=ON MueLu_SKIP_CTEST_ADD_TEST:BOOL=OFF MueLu_ALL_TARGETS:INTERNAL=muelu-adapters;muelu-interface;muelu MueLu_ENABLE_EXAMPLES-STRINGS:INTERNAL=;ON;OFF MueLu_ENABLE_TESTS-STRINGS:INTERNAL=;ON;OFF MueLu_EXPORTED_PACKAGE_LIBS_NAMES:INTERNAL=muelu;muelu-interface;muelu-adapters MueLu_FINISHED_FIRST_CONFIGURE:INTERNAL=TRUE MueLu_FULL_ENABLED_DEP_PACKAGES:INTERNAL=Intrepid2;Teko;Stratimikos;Ifpack2;Anasazi;Amesos2;ShyLU_NodeTacho;ShyLU_NodeHTS;Belos;ML;Ifpack;Zoltan2Core;Amesos;Galeri;AztecOO;Xpetra;Thyra;ThyraTpetraAdapters;ThyraEpetraExtAdapters;ThyraEpetraAdapters;ThyraCore;TrilinosSS;Tpetra;TpetraCore;TpetraTSQR;EpetraExt;Triutils;Shards;Zoltan;Epetra;Sacado;RTOp;KokkosKernels;Teuchos;TeuchosKokkosComm;TeuchosKokkosCompat;TeuchosRemainder;TeuchosNumerics;TeuchosComm;TeuchosParameterList;TeuchosParser;TeuchosCore;Kokkos;KokkosAlgorithms;KokkosContainers;KokkosCore MueLu_HAS_NATIVE_LIBRARIES_TO_INSTALL:INTERNAL=TRUE MueLu_HAVE_GO_INT:INTERNAL=OFF MueLu_HAVE_GO_LONG:INTERNAL=OFF MueLu_HAVE_GO_LONG_LONG:INTERNAL=ON MueLu_HIDE_DEPRECATED_CODE-ADVANCED:INTERNAL=1 MueLu_INST_COMPLEX_INT_INT:INTERNAL=OFF MueLu_INST_COMPLEX_INT_LONG_LONG:INTERNAL=ON MueLu_INST_DOUBLE_INT_INT:INTERNAL=OFF MueLu_INST_DOUBLE_INT_LONGINT:INTERNAL=OFF MueLu_INST_DOUBLE_INT_LONGLONGINT:INTERNAL=ON MueLu_INST_FLOAT_INT_INT:INTERNAL=OFF MueLu_INST_FLOAT_INT_LONG_LONG:INTERNAL=OFF MueLu_LIBRARIES:INTERNAL=MueLu::muelu-adapters;MueLu::muelu-interface;MueLu::muelu MueLu_LIB_OPTIONAL_DEP_PACKAGES:INTERNAL=Amesos;Amesos2;Belos;Epetra;EpetraExt;Teko;Ifpack;Ifpack2;Intrepid2;ML;Tpetra;Zoltan;Zoltan2Core;Stratimikos;Thyra;ThyraTpetraAdapters;Isorropia MueLu_LIB_REQUIRED_DEP_PACKAGES:INTERNAL=Teuchos;Xpetra;KokkosCore;KokkosContainers;KokkosKernels MueLu_LIB_TARGETS:INTERNAL=muelu-adapters;muelu-interface;muelu MueLu_PKG_VARS_TO_EXPORT:INTERNAL=MueLu_ENABLE_EXPLICIT_INSTANTIATION;HAVE_MUELU_EXPLICIT_INSTANTIATION;MueLu_ENABLE_DEBUG;HAVE_MUELU_DEBUG;MueLu_ENABLE_DEPRECATED_CODE;HAVE_MUELU_DEPRECATED_CODE;MueLu_ENABLE_DEPRECATED_TESTS;HAVE_MUELU_DEPRECATED_TESTS;MueLu_ENABLE_Experimental;HAVE_MUELU_EXPERIMENTAL;MueLu_ENABLE_ADDITIVE_VARIANT;HAVE_MUELU_ADDITIVE_VARIANT;MueLu_ENABLE_REGION_SPLITTING;HAVE_MUELU_REGION_SPLITTING;MueLu_ENABLE_Tutorial;MueLu_ENABLE_SPLIT_ETI_CPP_FILES;HAVE_MUELU_SPLIT_ETI_CPP_FILES;MueLu_ENABLE_PROFILING;HAVE_MUELU_PROFILING;MueLu_ENABLE_GOOGLE_PERFTOOLS;HAVE_MUELU_GOOGLE_PERFTOOLS;MueLu_ENABLE_Boost_for_real;HAVE_MUELU_BOOST_FOR_REAL;MueLu_ENABLE_Kokkos_Refactor;HAVE_MUELU_KOKKOS_REFACTOR;MueLu_ENABLE_ML_MMM;HAVE_MUELU_ML_MMM MueLu_SHOW_DEPRECATED_WARNINGS-ADVANCED:INTERNAL=1 MueLu_TEST_OPTIONAL_DEP_PACKAGES:INTERNAL=AztecOO;Pamgen MueLu_TEST_REQUIRED_DEP_PACKAGES:INTERNAL=Galeri ```
cgcgcg commented 2 years ago

Ok. We'll have to get that fixed ASAP then. Shouldn't be too difficult.

jjellio commented 2 years ago

Something is weird. My complex build was working in August, so I rolled back to that, but now that build fails (in Amesos2). I do know the admins updated the underlying GCC (c++ standard backing clang) to 11 I think... I wonder if this is some weird side effect

jjellio commented 2 years ago

This is an issue with the Kokkos-ification (Peter had a PR July 20th I believe). I rolled back to right before his PR and the error goes away, but that puts me more than a month backwards in time. I had pulled because I wanted to test the new Kokkos/KK promotions (the resolve some issues and remove lots of warnings).

I tried your branch in the process and that doesn't resolve it. I believe right now, I am just sitting at the commit right before Peter's PR. I'm guessing this is some annoyance with Magnitude Type vs Scalar Type (similar to issue #10963)

cgcgcg commented 2 years ago

@jjellio Could you pull the branch for #11001 once more and see if that fixes the issue?

jjellio commented 2 years ago

Yeah I can try it again maybe tonight (if a build finishes) or tomorrow.

jjellio commented 2 years ago

Your latest PR branch fixed this. I can't run unit tests due to system errors, but there are definitely no build errors!

We can close this, or perhaps have your PR branch close it when it is merged?

cgcgcg commented 2 years ago

Great! Thank you for checking!

cgcgcg commented 2 years ago

Fixed on develop.