search

trilinos / Trilinos

Primary repository for the Trilinos Project
https://trilinos.org/
Other
1.22k stars 569 forks source link

Tpetra: revert TAFC changes #13607

Closed jhux2 closed 1 day ago

jhux2 commented 6 days ago

Until we can diagnose segfaults reported wrt PR #13598.

This reverts commit 7eb5fe535ba8dd8bcd0172292e7b19c194c1c852, reversing changes made to e20e3cddc5391f2e148f4a4cf88f127badcdd457.

@trilinos/

Motivation

Segfaults reported in MiniEM.

Related Issues

Stakeholder Feedback

N/A

Testing

@skennon10 confirmed that reverted this MR fixes observed segfaults.

jhux2 commented 6 days ago

@NyquilDreams

trilinos-autotester commented 6 days ago

Status Flag 'Pre-Test Inspection' - Auto Inspected - Inspection is Not Necessary for this Pull Request.

trilinos-autotester commented 6 days ago

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: PR_gcc-openmpi-openmp

  • Build Num: 778
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-openmpi-4.1.6-openmp_release-debug_static_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca0e162bed51408f9716253ba1b7ccfec71
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f8309083ba41cf26ac8d768b8d3e3446bd

Build Information

Test Name: PR_gcc

  • Build Num: 828
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-serial_release-debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_no-mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca0e162bed51408f9716253ba1b7ccfec71
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f8309083ba41cf26ac8d768b8d3e3446bd

Build Information

Test Name: PR_gcc-openmpi_debug

  • Build Num: 829
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-openmpi-4.1.6-serial_debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca0e162bed51408f9716253ba1b7ccfec71
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f8309083ba41cf26ac8d768b8d3e3446bd

Build Information

Test Name: PR_clang

  • Build Num: 827
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-clang-11.0.1-openmpi-4.0.5-serial_release-debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca0e162bed51408f9716253ba1b7ccfec71
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f8309083ba41cf26ac8d768b8d3e3446bd

Build Information

Test Name: Trilinos_PR_python3

  • Build Num: 4786
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
BLOCKING_BUILD false
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_aue-gnu-12.1.0-anaconda3-serial_debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_no-mpi_no-pt_no-rdc_no-uvm_deprecated-on_pr-framework
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca0e162bed51408f9716253ba1b7ccfec71
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f8309083ba41cf26ac8d768b8d3e3446bd

Build Information

Test Name: PR_cuda

  • Build Num: 826
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-cuda-11.4.2-gnu-10.1.0-openmpi-4.1.6_release_static_Volta70_no-asan_complex_no-fpic_mpi_pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8-gpu
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca0e162bed51408f9716253ba1b7ccfec71
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f8309083ba41cf26ac8d768b8d3e3446bd

Build Information

Test Name: PR_intel

  • Build Num: 747
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-intel-2021.3-sems-openmpi-4.1.6_release-debug_shared_no-kokkos-arch_no-asan_no-complex_fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca0e162bed51408f9716253ba1b7ccfec71
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f8309083ba41cf26ac8d768b8d3e3446bd

Build Information

Test Name: PR_cuda-uvm

  • Build Num: 826
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-cuda-11.4.2-gnu-10.1.0-openmpi-4.1.6_release_static_Volta70_no-asan_complex_no-fpic_mpi_pt_no-rdc_uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca0e162bed51408f9716253ba1b7ccfec71
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f8309083ba41cf26ac8d768b8d3e3446bd

Using Repos:

Repo: TRILINOS (trilinos/Trilinos)
  • Branch: revert-tafc-changes
  • SHA: f5996ca0e162bed51408f9716253ba1b7ccfec71
  • Mode: TEST_REPO
Pull Request Author: jhux2
trilinos-autotester commented 6 days ago

Status Flag 'Pull Request AutoTester' - Jenkins Testing: 1 or more Jobs FAILED

Note: Testing will normally be attempted again in approx. 2 Hrs 30 Mins. If a change to the PR source branch occurs, the testing will be attempted again on next available autotester run.

Pull Request Auto Testing has FAILED (click to expand)

Build Information

Test Name: PR_gcc-openmpi-openmp

  • Build Num: 778
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-openmpi-4.1.6-openmp_release-debug_static_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca0e162bed51408f9716253ba1b7ccfec71
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f8309083ba41cf26ac8d768b8d3e3446bd

Build Information

Test Name: PR_gcc

  • Build Num: 828
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-serial_release-debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_no-mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca0e162bed51408f9716253ba1b7ccfec71
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f8309083ba41cf26ac8d768b8d3e3446bd

Build Information

Test Name: PR_gcc-openmpi_debug

  • Build Num: 829
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-openmpi-4.1.6-serial_debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca0e162bed51408f9716253ba1b7ccfec71
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f8309083ba41cf26ac8d768b8d3e3446bd

Build Information

Test Name: PR_clang

  • Build Num: 827
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-clang-11.0.1-openmpi-4.0.5-serial_release-debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca0e162bed51408f9716253ba1b7ccfec71
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f8309083ba41cf26ac8d768b8d3e3446bd

Build Information

Test Name: Trilinos_PR_python3

  • Build Num: 4786
  • Status: FAILED

Jenkins Parameters

Parameter Name Value
BLOCKING_BUILD false
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_aue-gnu-12.1.0-anaconda3-serial_debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_no-mpi_no-pt_no-rdc_no-uvm_deprecated-on_pr-framework
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca0e162bed51408f9716253ba1b7ccfec71
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f8309083ba41cf26ac8d768b8d3e3446bd

Build Information

Test Name: PR_cuda

  • Build Num: 826
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-cuda-11.4.2-gnu-10.1.0-openmpi-4.1.6_release_static_Volta70_no-asan_complex_no-fpic_mpi_pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8-gpu
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca0e162bed51408f9716253ba1b7ccfec71
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f8309083ba41cf26ac8d768b8d3e3446bd

Build Information

Test Name: PR_intel

  • Build Num: 747
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-intel-2021.3-sems-openmpi-4.1.6_release-debug_shared_no-kokkos-arch_no-asan_no-complex_fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca0e162bed51408f9716253ba1b7ccfec71
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f8309083ba41cf26ac8d768b8d3e3446bd

Build Information

Test Name: PR_cuda-uvm

  • Build Num: 826
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-cuda-11.4.2-gnu-10.1.0-openmpi-4.1.6_release_static_Volta70_no-asan_complex_no-fpic_mpi_pt_no-rdc_uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca0e162bed51408f9716253ba1b7ccfec71
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f8309083ba41cf26ac8d768b8d3e3446bd


CDash Test Results for PR# 13607.


Wiki: How to Reproduce PR Testing Builds and Errors.

eugeneswalker commented 1 day ago

Without this PR I was seeing segfaults for all of the following tests:

Amesos2_KLU2_Solver_Test_MPI_2
Amesos2_KLU2_UnitTests_MPI_2
Amesos2_SolverFactory_UnitTests_MPI_4
Amesos2_Tpetra_CrsMatrix_Adapter_UnitTests_MPI_4
TpetraCore_AdditiveSchwarzHalo_MPI_4
TpetraCore_AsyncTransfer_UnitTests_MPI_4
TpetraCore_BlockCrsMatrix_MPI_4
TpetraCore_Bug10008_MPI_4
TpetraCore_CrsMatrix_Bug8447_MPI_2
TpetraCore_CrsMatrix_transpose_sortedRows_MPI_4
TpetraCore_FECrs_MatrixMatrix_UnitTests_MPI_4
TpetraCore_ImportExport2_UnitTests_Alltoall_MPI_4
TpetraCore_ImportExport2_UnitTests_ISend_MPI_4
TpetraCore_ImportExport2_UnitTests_Send_MPI_4
TpetraCore_MatrixMatrix_UnitTests_MPI_4
TpetraCore_RowMatrixTransposer_test_MPI_4
TpetraCore_RowMatrixTransposer_UnitTests_MPI_4
Zoltan2_Coloring1_commanchedual_D1_nonzeros_MPI_4
Zoltan2_Coloring1_commanchedual_D1_rows_MPI_4
Zoltan2_Coloring1_commanchedual_D1-2GL_nonzeros_MPI_4
Zoltan2_Coloring1_commanchedual_D1-2GL_rows_MPI_4
Zoltan2_Coloring1_commanchedual_D2_MPI_4
Zoltan2_Coloring1_commanchedual_D2_nonzeros_MPI_4
Zoltan2_Coloring1_commanchedual_D2_rows_MPI_4
Zoltan2_Coloring1_commanchedual_PD2_MPI_4
Zoltan2_Coloring1_commanchedual_PD2_nonzeros_MPI_4
Zoltan2_Coloring1_commanchedual_PD2_rows_MPI_4
Zoltan2_Coloring1_complete_D2_MPI_4
Zoltan2_Coloring1_complete_PD2_MPI_4
Zoltan2_Coloring1_simple_D1_nonzeros_MPI_4
Zoltan2_Coloring1_simple_D1_rows_MPI_4
Zoltan2_Coloring1_simple_D1-2GL_nonzeros_MPI_4
Zoltan2_Coloring1_simple_D1-2GL_rows_MPI_4
Zoltan2_Coloring1_simple_D2_MPI_4
Zoltan2_Coloring1_simple_D2_nonzeros_MPI_4
Zoltan2_Coloring1_simple_D2_recolor_degrees_MPI_4
Zoltan2_Coloring1_simple_D2_rows_MPI_4
Zoltan2_Coloring1_simple_D2_serial_threshold_25_MPI_4
Zoltan2_Coloring1_simple_PD2_MPI_4
Zoltan2_Coloring1_simple_PD2_nonzeros_MPI_4
Zoltan2_Coloring1_simple_PD2_recolor_degrees_MPI_4
Zoltan2_Coloring1_simple_PD2_rows_MPI_4
Zoltan2_Coloring1_simple_PD2_serial_threshold_25_MPI_4
Zoltan2_GraphModel_MPI_4
Zoltan2_Partitioning1_ParMETIS_EWeights_MPI_4
Zoltan2_Partitioning1_ParMETIS_MPI_4
Zoltan2_Partitioning1_ParMETIS_OneProc_EWeights_MPI_4
Zoltan2_Partitioning1_ParMETIS_OneProc_MPI_4
Zoltan2_Partitioning1_ParMETIS_OneProc_VWeights_MPI_4
Zoltan2_Partitioning1_ParMETIS_VWeights_MPI_4
Zoltan2_Partitioning1_Quotient_MPI_4
Zoltan2_Partitioning1_Quotient_OneProc_MPI_4
Zoltan2_Partitioning1_Quotient_OneProc_Threshold1_MPI_4
Zoltan2_Partitioning1_Quotient_OneProc_Threshold2_MPI_4
Zoltan2_Partitioning1_Quotient_Threshold1_MPI_4
Zoltan2_Partitioning1_Quotient_Threshold2_MPI_4
Zoltan2_TpetraCrsColorer_galeri1_MPI_4
Zoltan2_TpetraCrsColorer_galeri2_MPI_4
Zoltan2_TpetraCrsColorer_simple_MPI_4
Zoltan2_TpetraCrsColorer_simple_nodistrib_MPI_4
Zoltan2_TpetraCrsColorer_troublecauser_MPI_4
Zoltan2_TpetraCrsColorer_west0067_MPI_4
Zoltan2_TpetraCrsColorer_west0067_nodistrib_MPI_4
Zoltan2_XpetraCrsMatrixInput_MPI_4
Zoltan2_XpetraTraits_MPI_4

With this PR I only see the following test from the above list continuing to segfault:

*** Unit test suite ...

Sorting tests by group name then by the order they were added ... (time = 2.58e-06)

Running unit tests ...

  1. SolverFactory_double_int_longlong_Tpetra_KokkosCompat_KokkosCudaWrapperNode_Solve_UnitTest ... Teuchos::GlobalMPISession::GlobalMPISession(): started processor with name 17e849900a29 and rank 1! Teuchos::GlobalMPISession::GlobalMPISession(): started processor with name 17e849900a29 and rank 2! Teuchos::GlobalMPISession::GlobalMPISession(): started processor with name 17e849900a29 and rank 3!

=================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = PID 1346602 RUNNING AT 17e849900a29 = EXIT CODE: 139 = CLEANING UP REMAINING PROCESSES = YOU CAN IGNORE THE BELOW CLEANUP MESSAGES

YOUR APPLICATION TERMINATED WITH THE EXIT STRING: Segmentation fault (signal 11) This typically refers to a problem with your application. Please see the FAQ page for debugging suggestions

0% tests passed, 1 tests failed out of 1

Subproject Time Summary: Amesos2 = 16.61 sec*proc (1 test)

Total Test time (real) = 4.72 sec

The following tests FAILED: 785 - Amesos2_SolverFactory_UnitTests_MPI_4 (Failed) Errors while running CTest

trilinos-autotester commented 1 day ago

Status Flag 'Pull Request AutoTester' - User Requested Retest - Label AT: RETEST will be reset after testing.

trilinos-autotester commented 1 day ago

Status Flag 'Pre-Test Inspection' - Auto Inspected - Inspection is Not Necessary for this Pull Request.

trilinos-autotester commented 1 day ago

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: PR_gcc-openmpi-openmp

  • Build Num: 805
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-openmpi-4.1.6-openmp_release-debug_static_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Build Information

Test Name: PR_gcc

  • Build Num: 855
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-serial_release-debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_no-mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Build Information

Test Name: PR_gcc-openmpi_debug

  • Build Num: 856
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-openmpi-4.1.6-serial_debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Build Information

Test Name: PR_clang

  • Build Num: 854
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-clang-11.0.1-openmpi-4.0.5-serial_release-debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Build Information

Test Name: Trilinos_PR_python3

  • Build Num: 4813
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
BLOCKING_BUILD false
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_aue-gnu-12.1.0-anaconda3-serial_debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_no-mpi_no-pt_no-rdc_no-uvm_deprecated-on_pr-framework
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Build Information

Test Name: PR_cuda

  • Build Num: 853
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-cuda-11.4.2-gnu-10.1.0-openmpi-4.1.6_release_static_Volta70_no-asan_complex_no-fpic_mpi_pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8-gpu
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Build Information

Test Name: PR_intel

  • Build Num: 774
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-intel-2021.3-sems-openmpi-4.1.6_release-debug_shared_no-kokkos-arch_no-asan_no-complex_fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Build Information

Test Name: PR_cuda-uvm

  • Build Num: 853
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-cuda-11.4.2-gnu-10.1.0-openmpi-4.1.6_release_static_Volta70_no-asan_complex_no-fpic_mpi_pt_no-rdc_uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Using Repos:

Repo: TRILINOS (trilinos/Trilinos)
  • Branch: revert-tafc-changes
  • SHA: 4b7b3509280193bc9b2b2bc275566789672d7292
  • Mode: TEST_REPO
Pull Request Author: jhux2
trilinos-autotester commented 1 day ago

Status Flag 'Pull Request AutoTester' - Jenkins Testing: 1 or more Jobs FAILED

Note: Testing will normally be attempted again in approx. 2 Hrs 30 Mins. If a change to the PR source branch occurs, the testing will be attempted again on next available autotester run.

Pull Request Auto Testing has FAILED (click to expand)

Build Information

Test Name: PR_gcc-openmpi-openmp

  • Build Num: 805
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-openmpi-4.1.6-openmp_release-debug_static_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Build Information

Test Name: PR_gcc

  • Build Num: 855
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-serial_release-debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_no-mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Build Information

Test Name: PR_gcc-openmpi_debug

  • Build Num: 856
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-openmpi-4.1.6-serial_debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Build Information

Test Name: PR_clang

  • Build Num: 854
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-clang-11.0.1-openmpi-4.0.5-serial_release-debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Build Information

Test Name: Trilinos_PR_python3

  • Build Num: 4813
  • Status: FAILED

Jenkins Parameters

Parameter Name Value
BLOCKING_BUILD false
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_aue-gnu-12.1.0-anaconda3-serial_debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_no-mpi_no-pt_no-rdc_no-uvm_deprecated-on_pr-framework
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Build Information

Test Name: PR_cuda

  • Build Num: 853
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-cuda-11.4.2-gnu-10.1.0-openmpi-4.1.6_release_static_Volta70_no-asan_complex_no-fpic_mpi_pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8-gpu
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Build Information

Test Name: PR_intel

  • Build Num: 774
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-intel-2021.3-sems-openmpi-4.1.6_release-debug_shared_no-kokkos-arch_no-asan_no-complex_fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Build Information

Test Name: PR_cuda-uvm

  • Build Num: 853
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-cuda-11.4.2-gnu-10.1.0-openmpi-4.1.6_release_static_Volta70_no-asan_complex_no-fpic_mpi_pt_no-rdc_uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466


CDash Test Results for PR# 13607.


Wiki: How to Reproduce PR Testing Builds and Errors.

trilinos-autotester commented 1 day ago

Status Flag 'Pull Request AutoTester' - User Requested Retest - Label AT: RETEST will be reset after testing.

trilinos-autotester commented 1 day ago

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: PR_gcc-openmpi-openmp

  • Build Num: 815
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-openmpi-4.1.6-openmp_release-debug_static_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Build Information

Test Name: PR_gcc

  • Build Num: 865
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-serial_release-debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_no-mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Build Information

Test Name: PR_gcc-openmpi_debug

  • Build Num: 866
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-openmpi-4.1.6-serial_debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Build Information

Test Name: PR_clang

  • Build Num: 864
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-clang-11.0.1-openmpi-4.0.5-serial_release-debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Build Information

Test Name: Trilinos_PR_python3

  • Build Num: 4823
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
BLOCKING_BUILD false
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_aue-gnu-12.1.0-anaconda3-serial_debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_no-mpi_no-pt_no-rdc_no-uvm_deprecated-on_pr-framework
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Build Information

Test Name: PR_cuda

  • Build Num: 863
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-cuda-11.4.2-gnu-10.1.0-openmpi-4.1.6_release_static_Volta70_no-asan_complex_no-fpic_mpi_pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8-gpu
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Build Information

Test Name: PR_intel

  • Build Num: 784
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-intel-2021.3-sems-openmpi-4.1.6_release-debug_shared_no-kokkos-arch_no-asan_no-complex_fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Build Information

Test Name: PR_cuda-uvm

  • Build Num: 863
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-cuda-11.4.2-gnu-10.1.0-openmpi-4.1.6_release_static_Volta70_no-asan_complex_no-fpic_mpi_pt_no-rdc_uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Using Repos:

Repo: TRILINOS (trilinos/Trilinos)
  • Branch: revert-tafc-changes
  • SHA: 4b7b3509280193bc9b2b2bc275566789672d7292
  • Mode: TEST_REPO
Pull Request Author: jhux2
trilinos-autotester commented 1 day ago

Status Flag 'Pull Request AutoTester' - Jenkins Testing: all Jobs PASSED

Pull Request Auto Testing has PASSED (click to expand)

Build Information

Test Name: PR_gcc-openmpi-openmp

  • Build Num: 815
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-openmpi-4.1.6-openmp_release-debug_static_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Build Information

Test Name: PR_gcc

  • Build Num: 865
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-serial_release-debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_no-mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Build Information

Test Name: PR_gcc-openmpi_debug

  • Build Num: 866
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-openmpi-4.1.6-serial_debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Build Information

Test Name: PR_clang

  • Build Num: 864
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-clang-11.0.1-openmpi-4.0.5-serial_release-debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Build Information

Test Name: Trilinos_PR_python3

  • Build Num: 4823
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
BLOCKING_BUILD false
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_aue-gnu-12.1.0-anaconda3-serial_debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_no-mpi_no-pt_no-rdc_no-uvm_deprecated-on_pr-framework
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Build Information

Test Name: PR_cuda

  • Build Num: 863
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-cuda-11.4.2-gnu-10.1.0-openmpi-4.1.6_release_static_Volta70_no-asan_complex_no-fpic_mpi_pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8-gpu
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Build Information

Test Name: PR_intel

  • Build Num: 784
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-intel-2021.3-sems-openmpi-4.1.6_release-debug_shared_no-kokkos-arch_no-asan_no-complex_fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466

Build Information

Test Name: PR_cuda-uvm

  • Build Num: 863
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-cuda-11.4.2-gnu-10.1.0-openmpi-4.1.6_release_static_Volta70_no-asan_complex_no-fpic_mpi_pt_no-rdc_uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b3509280193bc9b2b2bc275566789672d7292
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bdd97c69766e398ee5a0b687d67c93d3466


CDash Test Results for PR# 13607.

trilinos-autotester commented 1 day ago

Status Flag 'Pre-Merge Inspection' - SUCCESS: The last commit to this Pull Request has been INSPECTED AND APPROVED by [ cgcgcg ]!

trilinos-autotester commented 1 day ago

Status Flag 'Pull Request AutoTester' - Pull Request will be Automerged

trilinos-autotester commented 1 day ago

Merge on Pull Request# 13607: IS A SUCCESS - Pull Request successfully merged

NyquilDreams commented 11 hours ago

Without this PR I was seeing segfaults for all of the following tests:

Amesos2_KLU2_Solver_Test_MPI_2
Amesos2_KLU2_UnitTests_MPI_2
Amesos2_SolverFactory_UnitTests_MPI_4
Amesos2_Tpetra_CrsMatrix_Adapter_UnitTests_MPI_4
TpetraCore_AdditiveSchwarzHalo_MPI_4
TpetraCore_AsyncTransfer_UnitTests_MPI_4
TpetraCore_BlockCrsMatrix_MPI_4
TpetraCore_Bug10008_MPI_4
TpetraCore_CrsMatrix_Bug8447_MPI_2
TpetraCore_CrsMatrix_transpose_sortedRows_MPI_4
TpetraCore_FECrs_MatrixMatrix_UnitTests_MPI_4
TpetraCore_ImportExport2_UnitTests_Alltoall_MPI_4
TpetraCore_ImportExport2_UnitTests_ISend_MPI_4
TpetraCore_ImportExport2_UnitTests_Send_MPI_4
TpetraCore_MatrixMatrix_UnitTests_MPI_4
TpetraCore_RowMatrixTransposer_test_MPI_4
TpetraCore_RowMatrixTransposer_UnitTests_MPI_4
Zoltan2_Coloring1_commanchedual_D1_nonzeros_MPI_4
Zoltan2_Coloring1_commanchedual_D1_rows_MPI_4
Zoltan2_Coloring1_commanchedual_D1-2GL_nonzeros_MPI_4
Zoltan2_Coloring1_commanchedual_D1-2GL_rows_MPI_4
Zoltan2_Coloring1_commanchedual_D2_MPI_4
Zoltan2_Coloring1_commanchedual_D2_nonzeros_MPI_4
Zoltan2_Coloring1_commanchedual_D2_rows_MPI_4
Zoltan2_Coloring1_commanchedual_PD2_MPI_4
Zoltan2_Coloring1_commanchedual_PD2_nonzeros_MPI_4
Zoltan2_Coloring1_commanchedual_PD2_rows_MPI_4
Zoltan2_Coloring1_complete_D2_MPI_4
Zoltan2_Coloring1_complete_PD2_MPI_4
Zoltan2_Coloring1_simple_D1_nonzeros_MPI_4
Zoltan2_Coloring1_simple_D1_rows_MPI_4
Zoltan2_Coloring1_simple_D1-2GL_nonzeros_MPI_4
Zoltan2_Coloring1_simple_D1-2GL_rows_MPI_4
Zoltan2_Coloring1_simple_D2_MPI_4
Zoltan2_Coloring1_simple_D2_nonzeros_MPI_4
Zoltan2_Coloring1_simple_D2_recolor_degrees_MPI_4
Zoltan2_Coloring1_simple_D2_rows_MPI_4
Zoltan2_Coloring1_simple_D2_serial_threshold_25_MPI_4
Zoltan2_Coloring1_simple_PD2_MPI_4
Zoltan2_Coloring1_simple_PD2_nonzeros_MPI_4
Zoltan2_Coloring1_simple_PD2_recolor_degrees_MPI_4
Zoltan2_Coloring1_simple_PD2_rows_MPI_4
Zoltan2_Coloring1_simple_PD2_serial_threshold_25_MPI_4
Zoltan2_GraphModel_MPI_4
Zoltan2_Partitioning1_ParMETIS_EWeights_MPI_4
Zoltan2_Partitioning1_ParMETIS_MPI_4
Zoltan2_Partitioning1_ParMETIS_OneProc_EWeights_MPI_4
Zoltan2_Partitioning1_ParMETIS_OneProc_MPI_4
Zoltan2_Partitioning1_ParMETIS_OneProc_VWeights_MPI_4
Zoltan2_Partitioning1_ParMETIS_VWeights_MPI_4
Zoltan2_Partitioning1_Quotient_MPI_4
Zoltan2_Partitioning1_Quotient_OneProc_MPI_4
Zoltan2_Partitioning1_Quotient_OneProc_Threshold1_MPI_4
Zoltan2_Partitioning1_Quotient_OneProc_Threshold2_MPI_4
Zoltan2_Partitioning1_Quotient_Threshold1_MPI_4
Zoltan2_Partitioning1_Quotient_Threshold2_MPI_4
Zoltan2_TpetraCrsColorer_galeri1_MPI_4
Zoltan2_TpetraCrsColorer_galeri2_MPI_4
Zoltan2_TpetraCrsColorer_simple_MPI_4
Zoltan2_TpetraCrsColorer_simple_nodistrib_MPI_4
Zoltan2_TpetraCrsColorer_troublecauser_MPI_4
Zoltan2_TpetraCrsColorer_west0067_MPI_4
Zoltan2_TpetraCrsColorer_west0067_nodistrib_MPI_4
Zoltan2_XpetraCrsMatrixInput_MPI_4
Zoltan2_XpetraTraits_MPI_4

With this PR I only see the following test from the above list continuing to segfault:

  • Amesos2_SolverFactory_UnitTests_MPI_4
root@17e849900a29:/build# ctest --timeout 180 --output-on-failure -R "Amesos2_SolverFactory_UnitTests_MPI_4"
Test project /build
    Start 785: Amesos2_SolverFactory_UnitTests_MPI_4
1/1 Test #785: Amesos2_SolverFactory_UnitTests_MPI_4 ...***Failed  Required regular expression not found. Regex=[End Result: TEST PASSED
]  4.15 sec
Teuchos::GlobalMPISession::GlobalMPISession(): started processor with name 17e849900a29 and rank 0!

***
*** Unit test suite ...
***

Sorting tests by group name then by the order they were added ... (time = 2.58e-06)

Running unit tests ...

0. SolverFactory_double_int_longlong_Tpetra_KokkosCompat_KokkosCudaWrapperNode_Solve_UnitTest ... Teuchos::GlobalMPISession::GlobalMPISession(): started processor with name 17e849900a29 and rank 1!
Teuchos::GlobalMPISession::GlobalMPISession(): started processor with name 17e849900a29 and rank 2!
Teuchos::GlobalMPISession::GlobalMPISession(): started processor with name 17e849900a29 and rank 3!

===================================================================================
=   BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
=   PID 1346602 RUNNING AT 17e849900a29
=   EXIT CODE: 139
=   CLEANING UP REMAINING PROCESSES
=   YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
===================================================================================
YOUR APPLICATION TERMINATED WITH THE EXIT STRING: Segmentation fault (signal 11)
This typically refers to a problem with your application.
Please see the FAQ page for debugging suggestions

0% tests passed, 1 tests failed out of 1

Subproject Time Summary:
Amesos2    =  16.61 sec*proc (1 test)

Total Test time (real) =   4.72 sec

The following tests FAILED:
  785 - Amesos2_SolverFactory_UnitTests_MPI_4 (Failed)
Errors while running CTest

@eugeneswalker Hi Eugene, can you inform me of how you got these errors so I can recreate and fix them? A reproducer and information about your configuration would be helpful. Thanks.

eugeneswalker commented 10 hours ago

@eugeneswalker Hi Eugene, can you inform me of how you got these errors so I can recreate and fix them? A reproducer and information about your configuration would be helpful. Thanks.

Yes, absolutely.

We do our Trilinos builds inside Docker with GPU mapped in via nvidia-container-toolkit at the University of Oregon.

Here is how you could reproduce it. The cmake.sh is baked into the image, as are all build dependencies.

$> docker run -it --name trici-reproducer --gpus all esw123/trilinos-ci-cuda12.2.2:2024.11.05

# Clone source
root@460687cf30e1:/build# git clone https://github.com/trilinos/Trilinos /Trilinos
root@460687cf30e1:/build# git -C /Trilinos checkout d7d7ee234aaecf6fbed4bf3360d34770adc5d0d1

# CMake
root@17e849900a29:/build# export SOURCE_DIR=/Trilinos
root@17e849900a29:/build# export MPICH_CXX=$SOURCE_DIR/packages/kokkos/bin/nvcc_wrapper
root@17e849900a29:/build# export KOKKOS_ARCH=AMPERE80
root@460687cf30e1:/build# ./cmake.sh 2>&1 | tee cmake.output

# Build
root@460687cf30e1:/build# time ninja -j32
...

# Run tests
ctest --timeout 180 --output-on-failure -R "TpetraCore_BlockCrsMatrix_MPI_4|TpetraCore_Bug10008_MPI_4|TpetraCore_CrsMatrix_Bug8447_MPI_2|TpetraCore_ImportExport2_UnitTests_Send_MPI_4|TpetraCore_ImportExport2_UnitTests_ISend_MPI_4|TpetraCore_ImportExport2_UnitTests_Alltoall_MPI_4|TpetraCore_AsyncTransfer_UnitTests_MPI_4|TpetraCore_MatrixMatrix_UnitTests_MPI_4|TpetraCore_FECrs_MatrixMatrix_UnitTests_MPI_4|TpetraCore_RowMatrixTransposer_test_MPI_4|TpetraCore_RowMatrixTransposer_UnitTests_MPI_4|TpetraCore_CrsMatrix_transpose_sortedRows_MPI_4|TpetraCore_AdditiveSchwarzHalo_MPI_4|Amesos2_KLU2_UnitTests_MPI_2|Amesos2_KLU2_Solver_Test_MPI_2|Amesos2_SolverFactory_UnitTests_MPI_4|Amesos2_Tpetra_CrsMatrix_Adapter_UnitTests_MPI_4|Zoltan2_XpetraTraits_MPI_4|Zoltan2_XpetraCrsMatrixInput_MPI_4|Zoltan2_GraphModel_MPI_4|Zoltan2_Partitioning1_ParMETIS_MPI_4|Zoltan2_Partitioning1_ParMETIS_OneProc_MPI_4|Zoltan2_Partitioning1_ParMETIS_VWeights_MPI_4|Zoltan2_Partitioning1_ParMETIS_OneProc_VWeights_MPI_4|Zoltan2_Partitioning1_ParMETIS_EWeights_MPI_4|Zoltan2_Partitioning1_ParMETIS_OneProc_EWeights_MPI_4|Zoltan2_Partitioning1_Quotient_MPI_4|Zoltan2_Partitioning1_Quotient_OneProc_MPI_4|Zoltan2_Partitioning1_Quotient_Threshold1_MPI_4|Zoltan2_Partitioning1_Quotient_Threshold2_MPI_4|Zoltan2_Partitioning1_Quotient_OneProc_Threshold1_MPI_4|Zoltan2_Partitioning1_Quotient_OneProc_Threshold2_MPI_4|Zoltan2_TpetraCrsColorer_simple_MPI_4|Zoltan2_TpetraCrsColorer_simple_nodistrib_MPI_4|Zoltan2_TpetraCrsColorer_west0067_MPI_4|Zoltan2_TpetraCrsColorer_west0067_nodistrib_MPI_4|Zoltan2_TpetraCrsColorer_galeri1_MPI_4|Zoltan2_TpetraCrsColorer_galeri2_MPI_4|Zoltan2_TpetraCrsColorer_troublecauser_MPI_4|Zoltan2_Coloring1_simple_D1_rows_MPI_4|Zoltan2_Coloring1_simple_D1_nonzeros_MPI_4|Zoltan2_Coloring1_commanchedual_D1_rows_MPI_4|Zoltan2_Coloring1_commanchedual_D1_nonzeros_MPI_4|Zoltan2_Coloring1_simple_D1-2GL_rows_MPI_4|Zoltan2_Coloring1_simple_D1-2GL_nonzeros_MPI_4|Zoltan2_Coloring1_commanchedual_D1-2GL_rows_MPI_4|Zoltan2_Coloring1_commanchedual_D1-2GL_nonzeros_MPI_4|Zoltan2_Coloring1_simple_D2_MPI_4|Zoltan2_Coloring1_simple_D2_recolor_degrees_MPI_4|Zoltan2_Coloring1_simple_D2_serial_threshold_25_MPI_4|Zoltan2_Coloring1_simple_D2_rows_MPI_4|Zoltan2_Coloring1_simple_D2_nonzeros_MPI_4|Zoltan2_Coloring1_commanchedual_D2_MPI_4|Zoltan2_Coloring1_commanchedual_D2_rows_MPI_4|Zoltan2_Coloring1_commanchedual_D2_nonzeros_MPI_4|Zoltan2_Coloring1_complete_D2_MPI_4|Zoltan2_Coloring1_simple_PD2_MPI_4|Zoltan2_Coloring1_simple_PD2_recolor_degrees_MPI_4|Zoltan2_Coloring1_simple_PD2_serial_threshold_25_MPI_4|Zoltan2_Coloring1_simple_PD2_rows_MPI_4|Zoltan2_Coloring1_simple_PD2_nonzeros_MPI_4|Zoltan2_Coloring1_commanchedual_PD2_MPI_4|Zoltan2_Coloring1_commanchedual_PD2_rows_MPI_4|Zoltan2_Coloring1_commanchedual_PD2_nonzeros_MPI_4|Zoltan2_Coloring1_complete_PD2_MPI_4"
...
0% tests passed, 65 tests failed out of 65

Subproject Time Summary:
Amesos2    =  40.32 sec*proc (4 tests)
Tpetra     = 183.10 sec*proc (13 tests)
Zoltan2    = 696.32 sec*proc (48 tests)

Total Test time (real) = 234.73 sec

I shared this with @kuberry and I believe he shared with @ndellingwood and they were able to reproduce it. They may have used podman instead of Docker, but same concept.

Here is a failed pipeline run that shows the error:

jhux2 commented 9 hours ago

@kuberry @ndellingwood Is there an image that @NyquilDreams could use on the CEE lan?