trilinos / Trilinos

Primary repository for the Trilinos Project
https://trilinos.org/
Other
1.22k stars 570 forks source link

Framework: PR compile errors falsely showing up under Zoltan2Sphyx #10906

Closed jhux2 closed 2 years ago

jhux2 commented 2 years ago

Bug Report

@bartlettroscoe @GrahamBenHarper

Description

In some PR testing, compile failures are erroneously showing up under the subproject Zoltan2Sphyx. Here's a screenshot from #10902. (It's also happening in #10900, and probably others.)

Screen Shot 2022-08-19 at 2 26 10 PM

The actual compiler error happens during the build of one of MueLu's unit tests.

actual compiler error ``` FAILED: packages/muelu/test/unit_tests_kokkos/CMakeFiles/MueLu_UnitTests_kokkos.dir/Aggregates_kokkos.cpp.o /projects/sems/install/rhel7-x86_64/sems/compiler/gcc/7.2.0/openmpi/1.10.1/bin/mpicxx -I. -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/test/unit_tests_kokkos -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/test/unit_tests_kokkos/utils -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/test/unit_tests_kokkos/../../src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/test/unit_tests_kokkos/../../src/Transfers -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/test/unit_tests_kokkos/../../src/Transfers/BlockedTransfers -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/test/unit_tests_kokkos/../../src/Smoothers -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/test/unit_tests_kokkos/../../src/Smoothers/BlockedSmoothers -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/test/unit_tests_kokkos/../../gallery -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/test/unit_tests_kokkos/../../adapters -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/test/unit_tests_kokkos/../unit_tests -Ipackages/muelu/adapters -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/adapters/belos -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/adapters/tpetra -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/adapters/xpetra -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/adapters/stratimikos -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Graph -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Graph/BrickAggregation -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Graph/Containers -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Graph/CoupledAggregation -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Graph/HybridAggregation -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Graph/MatrixTransformation -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Graph/PairwiseAggregation -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Graph/StructuredAggregation -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Graph/StructuredAggregation/coupled -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Graph/StructuredAggregation/uncoupled -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Graph/UncoupledAggregation -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Graph/UserAggregation -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Headers -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Interface -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Interface/FacadeClasses -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Misc -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/MueCentral -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Rebalancing -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Smoothers -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Transfers/BaseClass -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Transfers/BlackBox -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Smoothers/BlockedSmoothers -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Transfers/BlockedTransfers -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Transfers/Classical -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Transfers/Energy-Minimization -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Transfers/Energy-Minimization/Solvers -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Transfers/GeneralGeometric -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Transfers/Generic -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Transfers/Geometric-Interpolation -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Transfers/Petrov-Galerkin-SA -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Transfers/SemiCoarsen -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Transfers/Smoothed-Aggregation -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Transfers/User -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Utils -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Utils/ForwardDeclaration -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/../adapters/xpetra -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/../adapters/tpetra -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Transfers/PCoarsen -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/../adapters/stratimikos -Ipackages/muelu/src -Ipackages/teuchos/core/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/teuchos/core/src -Ipackages/kokkos/core/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/kokkos/core/src -Ipackages/kokkos -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/teuchos/parser/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/teuchos/parameterlist/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/teuchos/comm/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/teuchos/numerics/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/teuchos/remainder/src -Ipackages/teuchos/remainder/src -Ipackages/teuchos/kokkoscompat/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/teuchos/kokkoscompat/src -Ipackages/teuchos/kokkoscomm/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/teuchos/kokkoscomm/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/xpetra/src/CrsGraph -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/xpetra/src/CrsMatrix -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/xpetra/src/BlockedCrsMatrix -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/xpetra/src/DistObject -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/xpetra/src/Export -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/xpetra/src/Headers -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/xpetra/src/Import -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/xpetra/src/Map -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/xpetra/src/BlockedMap -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/xpetra/src/MultiVector -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/xpetra/src/BlockedMultiVector -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/xpetra/src/BlockedVector -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/xpetra/src/Operator -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/xpetra/src/Platform -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/xpetra/src/RowGraph -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/xpetra/src/RowMatrix -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/xpetra/src/Utils -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/xpetra/src/Utils/ForwardDeclaration -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/xpetra/src/Vector -Ipackages/xpetra/src -Ipackages/kokkos/containers/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/kokkos/containers/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/tpetra/tsqr/src -Ipackages/tpetra/tsqr/src -Ipackages/kokkos-kernels/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/kokkos-kernels/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/kokkos-kernels/src/impl -Ipackages/kokkos-kernels/src/impl -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/kokkos-kernels/src/impl/tpls -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/kokkos-kernels/src/blas -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/kokkos-kernels/src/blas/impl -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/kokkos-kernels/src/sparse -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/kokkos-kernels/src/sparse/impl -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/kokkos-kernels/src/graph -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/kokkos-kernels/src/graph/impl -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/kokkos-kernels/src/batched -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/kokkos-kernels/src/batched/dense -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/kokkos-kernels/src/batched/dense/impl -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/kokkos-kernels/src/batched/sparse -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/kokkos-kernels/src/batched/sparse/impl -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/kokkos-kernels/src/common -Ipackages/kokkos/algorithms/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/kokkos/algorithms/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/tpetra/core/compat -Ipackages/tpetra/core/compat -Ipackages/epetra/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/epetra/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/tpetra/core/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/tpetra/core/src/kokkos_refactor -Ipackages/tpetra/core/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/tpetra/core/inout -Ipackages/tpetra/core/inout -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/tpetra/core/ext -Ipackages/tpetra/core/ext -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/thyra/core/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/thyra/core/src/interfaces/operator_vector/fundamental -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/thyra/core/src/interfaces/operator_vector/extended -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/thyra/core/src/support/operator_vector/client_support -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/thyra/core/src/support/operator_vector/adapter_support -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/thyra/core/src/interfaces/operator_solve/fundamental -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/thyra/core/src/interfaces/operator_solve/extended -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/thyra/core/src/support/operator_solve/client_support -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/thyra/core/src/interfaces/nonlinear/model_evaluator/fundamental -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/thyra/core/src/support/nonlinear/model_evaluator/client_support -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/thyra/core/src/interfaces/nonlinear/solvers/fundamental -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/thyra/core/src/support/nonlinear/solvers/client_support -Ipackages/thyra/core/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/thyra/core/example/operator_vector -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/rtop/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/rtop/src/interfaces -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/rtop/src/support -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/rtop/src/ops_lib -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/rtop/src/lapack -Ipackages/rtop/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/thyra/adapters/epetra/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/thyra/adapters/epetraext/src/model_evaluator -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/thyra/adapters/epetraext/src/transformer -Ipackages/epetraext/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/epetraext/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/epetraext/src/transform -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/epetraext/src/inout -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/epetraext/src/coloring -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/epetraext/src/model_evaluator -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/epetraext/src/block -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/epetraext/src/restrict -Ipackages/triutils/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/triutils/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/thyra/adapters/tpetra/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/xpetra/sup/Matrix -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/xpetra/sup/StridedMap -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/xpetra/sup/Utils -Ipackages/xpetra/sup -Ipackages/amesos/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/amesos/src -Ipackages/common/auxiliarySoftware/SuiteSparse/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/common/auxiliarySoftware/SuiteSparse/src/AMD/Include -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/common/auxiliarySoftware/SuiteSparse/src/BTF/Include -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/common/auxiliarySoftware/SuiteSparse/src/CAMD/Include -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/common/auxiliarySoftware/SuiteSparse/src/CCOLAMD/Include -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/common/auxiliarySoftware/SuiteSparse/src/COLAMD/Include -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/common/auxiliarySoftware/SuiteSparse/src/KLU/Include -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/common/auxiliarySoftware/SuiteSparse/src/UFconfig -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos -Ipackages/amesos2/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/amesos2/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/amesos2/src/KLU2/Include -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/amesos2/src/KLU2/Source -Ipackages/shylu/shylu_node/tacho/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/shylu/shylu_node/tacho/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/shylu/shylu_node/tacho/src/impl -Ipackages/belos/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/belos/src -Ipackages/aztecoo/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/aztecoo/src -Ipackages/belos/epetra/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/belos/epetra/src -Ipackages/belos/tpetra/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/belos/tpetra/src -Ipackages/belos/xpetra/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/belos/xpetra/src -Ipackages/teko/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/teko/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/teko/src/NS -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/teko/src/Epetra -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/teko/src/Tpetra -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/stratimikos/adapters/ifpack/src -Ipackages/ifpack/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/ifpack/src -Ipackages/ml/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/ml/src/Include -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/ml/src/Comm -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/ml/src/Coarsen -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/ml/src/FEGrid -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/ml/src/Main -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/ml/src/Smoother -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/ml/src/Krylov -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/ml/src/Operator -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/ml/src/Utils -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/ml/src/RefMaxwell -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/ml/src/MatrixFree -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/ml/src/MLAPI -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/ml/src/LevelWrap -Ipackages/zoltan/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan/src/include -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan/src/all -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan/src/coloring -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan/src/graph -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan/src/ha -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan/src/hier -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan/src/hsfc -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan/src/lb -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan/src/matrix -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan/src/order -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan/src/par -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan/src/params -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan/src/tpls -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan/src/phg -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan/src/rcb -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan/src/reftree -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan/src/simple -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan/src/timer -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan/src/Utilities/Communication -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan/src/Utilities/DDirectory -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan/src/Utilities/Timer -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan/src/Utilities/shared -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan/src/zz -Ipackages/galeri/src-epetra -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/galeri/src-epetra -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/galeri/src-epetra/Maps -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/galeri/src-epetra/CRSMatrices -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/galeri/src-epetra/FiniteElements -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/galeri/src-xpetra -Ipackages/galeri/src-xpetra -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/galeri/src-xpetra/../src-epetra -Ipackages/galeri/src-xpetra/../src-epetra -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/galeri/src-xpetra/../src/Utils -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/galeri/src-xpetra/../src/Headers -Ipackages/isorropia/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/isorropia/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/isorropia/src/epetra -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/isorropia/src/epetra/zoltanLib -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/stratimikos/adapters/ml/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/stratimikos/adapters/amesos/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/stratimikos/adapters/aztecoo/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/stratimikos/adapters/amesos2/src -Ipackages/stratimikos/adapters/amesos2/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/stratimikos/adapters/belos/src -Ipackages/stratimikos/adapters/belos/src -Ipackages/stratimikos/adapters/belos/src/../../../src -Ipackages/stratimikos/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/stratimikos/src -Ipackages/anasazi/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/anasazi/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/anasazi/src/../thyra/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/anasazi/src/../tpetra/src -Ipackages/anasazi/epetra/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/anasazi/epetra/src -Ipackages/anasazi/epetra/util/ModeLaplace -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/anasazi/epetra/util/ModeLaplace -Ipackages/anasazi/tpetra/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/anasazi/tpetra/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/ifpack2/src -Ipackages/ifpack2/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan2/core/src -Ipackages/zoltan2/core/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan2/core/src/algorithms -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan2/core/src/algorithms/partition -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan2/core/src/algorithms/order -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan2/core/src/algorithms/color -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan2/core/src/algorithms/match -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan2/core/src/algorithms/map -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan2/core/src/algorithms/zoltan -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan2/core/src/environment -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan2/core/src/include -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan2/core/src/input -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan2/core/src/models -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan2/core/src/problems -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan2/core/src/TpetraCrsColorer -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan2/core/src/util -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/zoltan2/core/src/directory -Ipackages/shylu/shylu_node/hts/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/shylu/shylu_node/hts/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/ifpack2/adapters/thyra -Ipackages/ifpack2/adapters -Ipackages/intrepid2/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/intrepid2/src/Cell -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/intrepid2/src/Discretization/Basis -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/intrepid2/src/Discretization/FunctionSpaceTools -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/intrepid2/src/Discretization/Integration -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/intrepid2/src/Orientation -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/intrepid2/src/Projection -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/intrepid2/src/Shared -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/intrepid2/src -Ipackages/shards/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/shards/src -Ipackages/sacado/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/sacado/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/sacado/src/new_design -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/sacado/src/template -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/sacado/src/parameter -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/sacado/src/mpl -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Interface/../Graph -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Interface/../Graph/BrickAggregation -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Interface/../Graph/UncoupledAggregation -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Interface/../Graph/UserAggregation -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Interface/../Headers -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Interface/../Misc -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Interface/../MueCentral -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Interface/../Rebalancing -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Interface/../Smoothers -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Interface/../Transfers/BaseClass -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Interface/../Smoothers/BlockedSmoothers -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Interface/../Transfers/BlockedTransfers -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Interface/../Transfers/Generic -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Interface/../Transfers/Energy-Minimization -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Interface/../Transfers/Energy-Minimization/Solvers -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Interface/../Transfers/GeneralGeometric -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Interface/../Transfers/Geometric-Interpolation -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Interface/../Transfers/Smoothed-Aggregation -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Interface/../Transfers/Petrov-Galerkin-SA -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Interface/../Transfers/User -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Interface/../Transfers/SemiCoarsen -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Interface/../Utils -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Interface/../Utils/ForwardDeclaration -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/src/Interface/../../adapters/tpetra -Ipackages/muelu/src/Interface -Ipackages/pamgen/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/pamgen/src -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/pamgen/mesh_spec_lt -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/pamgen/extra_functions -I/scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/pamgen/rtcompiler -isystem /projects/sems/install/rhel7-x86_64/sems/tpl/boost/1.63.0/gcc/7.2.0/base/include -isystem /projects/sems/install/rhel7-x86_64/sems/tpl/superlu/4.3/gcc/7.2.0/base/include -isystem /projects/sems/install/rhel7-x86_64/sems/tpl/hdf5/1.10.6/gcc/7.2.0/openmpi/1.10.1/parallel/include -isystem /projects/sems/install/rhel7-x86_64/sems/tpl/parmetis/4.0.3/gcc/7.2.0/openmpi/1.10.1/parallel/include -isystem /projects/sems/install/rhel7-x86_64/sems/tpl/scotch/6.0.3/gcc/7.2.0/openmpi/1.10.1/nopthread_64bit_parallel/include -isystem /projects/sems/install/rhel7-x86_64/sems/tpl/zlib/1.2.8/gcc/7.2.0/base/include -pedantic -Wall -Wno-long-long -Wwrite-strings -Wshadow -Woverloaded-virtual -Wall -Wno-clobbered -Wno-vla -Wno-pragmas -Wno-unknown-pragmas -Wno-unused-local-typedefs -Wno-literal-suffix -Wno-deprecated-declarations -Wno-misleading-indentation -Wno-int-in-bool-context -Wno-maybe-uninitialized -Wno-nonnull-compare -Wno-address -Wno-inline -Werror -DTRILINOS_HIDE_DEPRECATED_HEADER_WARNINGS -Wno-unused-local-typedefs -g -O0 -std=c++14 -MD -MT packages/muelu/test/unit_tests_kokkos/CMakeFiles/MueLu_UnitTests_kokkos.dir/Aggregates_kokkos.cpp.o -MF packages/muelu/test/unit_tests_kokkos/CMakeFiles/MueLu_UnitTests_kokkos.dir/Aggregates_kokkos.cpp.o.d -o packages/muelu/test/unit_tests_kokkos/CMakeFiles/MueLu_UnitTests_kokkos.dir/Aggregates_kokkos.cpp.o -c /scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/test/unit_tests_kokkos/Aggregates_kokkos.cpp In file included from /scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/teuchos/core[Teuchos_LocalTestingHelpers.hpp:56](https://github.com/trilinos/Trilinos//blob/master/Teuchos_LocalTestingHelpers.hpp#L56):0, from /scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/teuchos/core[Teuchos_UnitTestHarness.hpp:54](https://github.com/trilinos/Trilinos//blob/master/Teuchos_UnitTestHarness.hpp#L54), from /scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/test/unit_tests_kokkos/Aggregates_kokkos.cpp:46: /scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/test/unit_tests_kokkos/Aggregates_kokkos.cpp: In instantiation of ‘void MueLuTests::Aggregates_kokkos_UncoupledPhase3_UnitTest::runUnitTestImpl(Teuchos::FancyOStream&, bool&) const [with Scalar = double; LocalOrdinal = int; GlobalOrdinal = long long int; Node = Kokkos::Compat::KokkosDeviceWrapperNode; Teuchos::FancyOStream = Teuchos::basic_FancyOStream]’: /scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu[Utils/MueLu_ETI_4arg.hpp:42](https://github.com/trilinos/Trilinos//blob/master/Utils/MueLu_ETI_4arg.hpp#L42):3: required from here /scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/teuchos/core[Teuchos_TestingHelpers.hpp:324](https://github.com/trilinos/Trilinos//blob/master/Teuchos_TestingHelpers.hpp#L324):32: error: comparison between signed and unsigned integer expressions [-Werror=sign-compare] const bool l_result = (v1) == (v2); \ [CTest: warning matched] /scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/teuchos/core[Teuchos_LocalTestingHelpers.hpp:88](https://github.com/trilinos/Trilinos//blob/master/Teuchos_LocalTestingHelpers.hpp#L88):3: note: in expansion of macro ‘TEUCHOS_TEST_EQUALITY’ TEUCHOS_TEST_EQUALITY( v1, v2, out, success ) ^~~~~~~~~~~~~~~~~~~~~ [CTest: warning matched] /scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/test/unit_tests_kokkos/Aggregates_kokkos.cpp:617:5: note: in expansion of macro ‘TEST_EQUALITY’ TEST_EQUALITY(aggPtr.extent(0), numAggs+1); ^ /scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/test/unit_tests_kokkos/Aggregates_kokkos.cpp:625:18: error: comparison between signed and unsigned integer expressions [-Werror=sign-compare] for(LO i=0; i::runUnitTestImpl(Teuchos::FancyOStream&, bool&) const [with Scalar = std::complex; LocalOrdinal = int; GlobalOrdinal = long long int; Node = Kokkos::Compat::KokkosDeviceWrapperNode; Teuchos::FancyOStream = Teuchos::basic_FancyOStream]’: /scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu[Utils/MueLu_ETI_4arg.hpp:42](https://github.com/trilinos/Trilinos//blob/master/Utils/MueLu_ETI_4arg.hpp#L42):3: required from here /scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/teuchos/core[Teuchos_TestingHelpers.hpp:324](https://github.com/trilinos/Trilinos//blob/master/Teuchos_TestingHelpers.hpp#L324):32: error: comparison between signed and unsigned integer expressions [-Werror=sign-compare] const bool l_result = (v1) == (v2); \ [CTest: warning matched] /scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/teuchos/core[Teuchos_LocalTestingHelpers.hpp:88](https://github.com/trilinos/Trilinos//blob/master/Teuchos_LocalTestingHelpers.hpp#L88):3: note: in expansion of macro ‘TEUCHOS_TEST_EQUALITY’ TEUCHOS_TEST_EQUALITY( v1, v2, out, success ) ^~~~~~~~~~~~~~~~~~~~~ [CTest: warning matched] /scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/test/unit_tests_kokkos/Aggregates_kokkos.cpp:617:5: note: in expansion of macro ‘TEST_EQUALITY’ TEST_EQUALITY(aggPtr.extent(0), numAggs+1); ^ /scratch/trilinos/jenkins/ascic142/workspace/Trilinos_PR_gcc-7.2.0-debug/Trilinos/packages/muelu/test/unit_tests_kokkos/Aggregates_kokkos.cpp:625:18: error: comparison between signed and unsigned integer expressions [-Werror=sign-compare] for(LO i=0; i
GrahamBenHarper commented 2 years ago

From this comment, I know it has been happening since at least July 1 in #10606, if not farther back. I guess I just assumed everybody clicked past it and read the output.

jhux2 commented 2 years ago

And of course, there's #10836.

bartlettroscoe commented 2 years ago

FYI: This is really a duplicate of #10823.

bartlettroscoe commented 2 years ago

@jhux2, @GrahamBenHarper, this behavior was noted in #10823. I am working with @zackgalbreath at Kitware to try to figure this out the best we can (see SNL Kitware #209). There are several challenges. First, we can't see the XML files getting generated on the Jenkins clients (see TRILINOSHD-188)). Also, it is very hard to get to the XML files that are submitted to trilinos-cdash.sandia.gov. (Kitware did not set up that CDash server and has limited access to it.) I did not write the code run by the ctest -S script and I don't even know where that code lives. All of this is owned by the Trilinos Framework team. They own the Jenkins jobs, they own the CDash server, they own the code that is run on the Jenkins server. I have no way to reproduce anything. It is an extremely difficult situation to deal with.

jhux2 commented 2 years ago

@bartlettroscoe Thanks, I didn't realize this was already being tracked. (I only searched titles.) For anyone who has read this far, see https://github.com/trilinos/Trilinos/issues/10823#issuecomment-1206856350, which is exactly what I reported here.

I'll close this issue in favor of #10823.