search

trilinos / Trilinos

Primary repository for the Trilinos Project
https://trilinos.org/
Other
1.2k stars 563 forks source link

Belos and ROL tests failing in ASTRA 'van1-tx2' debug builds showing final "TEST PASSED" but then aborting on shutdown #8486

Closed bartlettroscoe closed 2 years ago

bartlettroscoe commented 3 years ago

CC: @trilinos/belos, @trilinos/rol, @srajama1 (Trilinos Linear Solvers Product Lead), @rppawlo (Trilinos Nonlinear Solvers Product Lead)

## Next Action Status ## Description As shown in [this query](https://testing.sandia.gov/cdash/queryTests.php?project=Trilinos&begin=2020-11-16&end=2020-12-14&filtercount=10&showfilters=1&filtercombine=and&field1=groupname&compare1=62&value1=Experimental&field2=buildname&compare2=65&value2=Trilinos-atdm-van1-tx2&field3=status&compare3=62&value3=passed&field4=testoutput&compare4=94&value4=Error%20initializing%20RM%20connection.%20Exiting&field5=testoutput&compare5=96&value5=srun%3A%20error%3A%20s_p_parse_file%3A%20unable%20to%20read%20.%2Fetc%2Fslurm%2Fslurm.conf.%3A%20Permission%20denied&field6=testoutput&compare6=96&value6=cudaGetDeviceCount.*cudaErrorUnknown.*unknown%20error.*Kokkos_Cuda_Instance.cpp&field7=testoutput&compare7=96&value7=cudaMallocManaged.*cudaErrorUnknown.*unknown%20error.*Sacado_DynamicArrayTraits.hpp&field8=testoutput&compare8=96&value8=srun%3A%20error.*launch%20failed%3A%20Error%20configuring%20interconnect&field9=testoutput&compare9=95&value9=Signal%3A%20Aborted%20(6)&field10=testoutput&compare10=95&value10=End%20Result%3A%20TEST%20PASSED) (click "Shown Matching Output" in upper right) the tests: * `Belos_CustomSolverFactory_MPI_4` * `ROL_test_vector_StdArrayInterface_MPI_1` in the builds: * `Trilinos-atdm-van1-tx2_arm-20.0_openmpi-4.0.2_openmp_static_dbg` * `Trilinos-atdm-van1-tx2_arm-20.1_openmpi-4.0.3_openmp_static_dbg` which were failing since these 'van1-tx2' builds were first set up. These all fail showing the final pass line `End Result: TEST PASSED` but then abort showing a bunch of non-deleted RCPNode objects with output like [here](https://testing.sandia.gov/cdash/test/43512586) showing: ``` End Result: TEST PASSED ... *** *** Warning! The following Teuchos::RCPNode objects were created but have *** not been destroyed yet. A memory checking tool may complain that these *** objects are not destroyed correctly. *** ... Throw test that evaluated to true: !(rcp_node_list()) Error! what(): /lustre/jenkins/stria/workspace/Trilinos-atdm-van1-tx2_arm-20.0_openmpi-4.0.2_openmp_static_dbg/SRC_AND_BUILD/Trilinos/packages/teuchos/core/src/Teuchos_RCPNode.cpp:535: Throw number = 1 Throw test that evaluated to true: !(rcp_node_list()) Error! [st1:147200] *** Process received signal *** [st1:147200] Signal: Aborted (6) [st1:147200] Signal code: (-6) ... ``` ## Current Status on CDash Run the [above query](https://testing.sandia.gov/cdash/queryTests.php?project=Trilinos&begin=2020-11-16&end=2020-12-14&filtercount=10&showfilters=1&filtercombine=and&field1=groupname&compare1=62&value1=Experimental&field2=buildname&compare2=65&value2=Trilinos-atdm-van1-tx2&field3=status&compare3=62&value3=passed&field4=testoutput&compare4=94&value4=Error%20initializing%20RM%20connection.%20Exiting&field5=testoutput&compare5=96&value5=srun%3A%20error%3A%20s_p_parse_file%3A%20unable%20to%20read%20.%2Fetc%2Fslurm%2Fslurm.conf.%3A%20Permission%20denied&field6=testoutput&compare6=96&value6=cudaGetDeviceCount.*cudaErrorUnknown.*unknown%20error.*Kokkos_Cuda_Instance.cpp&field7=testoutput&compare7=96&value7=cudaMallocManaged.*cudaErrorUnknown.*unknown%20error.*Sacado_DynamicArrayTraits.hpp&field8=testoutput&compare8=96&value8=srun%3A%20error.*launch%20failed%3A%20Error%20configuring%20interconnect&field9=testoutput&compare9=95&value9=Signal%3A%20Aborted%20(6)&field10=testoutput&compare10=95&value10=End%20Result%3A%20TEST%20PASSED) adjusting the "Begin" and "End" dates to match today any other date range or just click "CURRENT" in the top bar to see results for the current testing day. ## Steps to Reproduce One should be able to reproduce this failure as described in: * https://github.com/trilinos/Trilinos/blob/develop/cmake/std/atdm/README.md and the system-specific instructions at: * https://github.com/trilinos/Trilinos/blob/develop/cmake/std/atdm/README.md#specific-instructions-for-each-system Just log into any of the associated machines and copy and paste the full CDash build name `` listed above and run commands like: ``` $ cd / $ source $TRILINOS_DIR/cmake/std/atdm/load-env.sh $ cmake \ -GNinja \ -DTrilinos_CONFIGURE_OPTIONS_FILE:STRING=cmake/std/atdm/ATDMDevEnv.cmake \ -DTrilinos_ENABLE_TESTS=ON -DTrilinos_ENABLE_=ON \ $TRILINOS_DIR $ make NP=16 $ ctest -j4 ``` where `` is any package that you want to enabled to reproduce build and/or test results. Again, for exact system-specific details on what commands to run to build and run tests, see: * https://github.com/trilinos/Trilinos/blob/develop/cmake/std/atdm/README.md#specific-instructions-for-each-system And if you can't figure out what commands to run to produce the issue given the above-referenced documentation, please post a comment here and we will give you the exact minimal commands to reproduce the failures.
grover-trilinos commented 3 years ago

Test results for issue #8486 as of 2020-12-21

Tests with issue trackers Failed: twif=4

Detailed test results: (click to expand)

Tests with issue trackers Failed: twif=4

Site Build Name Test Name Status Details Consec­utive Non-pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
stria Trilinos-atdm-van1-tx2_­arm-20.0_­openmpi-4.0.2_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 30 30 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.1_­openmpi-4.0.3_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 30 30 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.0_­openmpi-4.0.2_­openmp_­static_­dbg ROL_­test_­vector_­StdArrayInterface_­MPI_­1 Failed Completed (Failed) 30 30 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.1_­openmpi-4.0.3_­openmp_­static_­dbg ROL_­test_­vector_­StdArrayInterface_­MPI_­1 Failed Completed (Failed) 30 30 0 #8486

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

grover-trilinos commented 3 years ago

Test results for issue #8486 as of 2020-12-27

Tests with issue trackers Failed: twif=4

Detailed test results: (click to expand)

Tests with issue trackers Failed: twif=4

Site Build Name Test Name Status Details Consec­utive Non-pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
stria Trilinos-atdm-van1-tx2_­arm-20.0_­openmpi-4.0.2_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 30 30 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.1_­openmpi-4.0.3_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 30 30 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.0_­openmpi-4.0.2_­openmp_­static_­dbg ROL_­test_­vector_­StdArrayInterface_­MPI_­1 Failed Completed (Failed) 30 30 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.1_­openmpi-4.0.3_­openmp_­static_­dbg ROL_­test_­vector_­StdArrayInterface_­MPI_­1 Failed Completed (Failed) 30 30 0 #8486

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

grover-trilinos commented 3 years ago

Test results for issue #8486 as of 2021-01-10

Tests with issue trackers Failed: twif=4

Detailed test results: (click to expand)

Tests with issue trackers Failed: twif=4

Site Build Name Test Name Status Details Consec­utive Non-pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
stria Trilinos-atdm-van1-tx2_­arm-20.0_­openmpi-4.0.2_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 30 30 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.1_­openmpi-4.0.3_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 30 30 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.0_­openmpi-4.0.2_­openmp_­static_­dbg ROL_­test_­vector_­StdArrayInterface_­MPI_­1 Failed Completed (Failed) 30 30 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.1_­openmpi-4.0.3_­openmp_­static_­dbg ROL_­test_­vector_­StdArrayInterface_­MPI_­1 Failed Completed (Failed) 30 30 0 #8486

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

grover-trilinos commented 3 years ago

Test results for issue #8486 as of 2021-01-17

Tests with issue trackers Failed: twif=4

Detailed test results: (click to expand)

Tests with issue trackers Failed: twif=4

Site Build Name Test Name Status Details Consec­utive Non-pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
stria Trilinos-atdm-van1-tx2_­arm-20.0_­openmpi-4.0.2_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 30 30 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.1_­openmpi-4.0.3_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 30 30 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.0_­openmpi-4.0.2_­openmp_­static_­dbg ROL_­test_­vector_­StdArrayInterface_­MPI_­1 Failed Completed (Failed) 30 30 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.1_­openmpi-4.0.3_­openmp_­static_­dbg ROL_­test_­vector_­StdArrayInterface_­MPI_­1 Failed Completed (Failed) 30 30 0 #8486

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

grover-trilinos commented 3 years ago

Test results for issue #8486 as of 2021-01-31

Tests with issue trackers Failed: twif=2

Detailed test results: (click to expand)

Tests with issue trackers Failed: twif=2

Site Build Name Test Name Status Details Consec­utive Non-pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
stria Trilinos-atdm-van1-tx2_­arm-20.0_­openmpi-4.0.2_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 27 27 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.1_­openmpi-4.0.3_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 27 27 0 #8486

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

grover-trilinos commented 3 years ago

Test results for issue #8486 as of 2021-02-07

Tests with issue trackers Failed: twif=2

Detailed test results: (click to expand)

Tests with issue trackers Failed: twif=2

Site Build Name Test Name Status Details Consec­utive Non-pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
stria Trilinos-atdm-van1-tx2_­arm-20.0_­openmpi-4.0.2_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 26 26 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.1_­openmpi-4.0.3_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 26 26 0 #8486

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

grover-trilinos commented 3 years ago

Test results for issue #8486 as of 2021-02-14

Tests with issue trackers Failed: twif=2

Detailed test results: (click to expand)

Tests with issue trackers Failed: twif=2

Site Build Name Test Name Status Details Consec­utive Non-pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
stria Trilinos-atdm-van1-tx2_­arm-20.0_­openmpi-4.0.2_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 26 26 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.1_­openmpi-4.0.3_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 26 26 0 #8486

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

grover-trilinos commented 3 years ago

Test results for issue #8486 as of 2021-02-21

Tests with issue trackers Failed: twif=2

Detailed test results: (click to expand)

Tests with issue trackers Failed: twif=2

Site Build Name Test Name Status Details Consec­utive Non-pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
stria Trilinos-atdm-van1-tx2_­arm-20.0_­openmpi-4.0.2_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 25 25 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.1_­openmpi-4.0.3_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 24 24 0 #8486

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

grover-trilinos commented 3 years ago

Test results for issue #8486 as of 2021-03-14

Tests with issue trackers Failed: twif=2

Detailed test results: (click to expand)

Tests with issue trackers Failed: twif=2

Site Build Name Test Name Status Details Consec­utive Non-pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
stria Trilinos-atdm-van1-tx2_­arm-20.0_­openmpi-4.0.2_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 16 16 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.1_­openmpi-4.0.3_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 14 14 0 #8486

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

grover-trilinos commented 3 years ago

Test results for issue #8486 as of 2021-03-21

Tests with issue trackers Failed: twif=2

Detailed test results: (click to expand)

Tests with issue trackers Failed: twif=2

Site Build Name Test Name Status Details Consec­utive Non-pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
stria Trilinos-atdm-van1-tx2_­arm-20.0_­openmpi-4.0.2_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 18 18 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.1_­openmpi-4.0.3_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 17 17 0 #8486

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

grover-trilinos commented 3 years ago

Test results for issue #8486 as of 2021-03-28

Tests with issue trackers Failed: twif=2

Detailed test results: (click to expand)

Tests with issue trackers Failed: twif=2

Site Build Name Test Name Status Details Consec­utive Non-pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
stria Trilinos-atdm-van1-tx2_­arm-20.0_­openmpi-4.0.2_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 20 20 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.1_­openmpi-4.0.3_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 20 20 0 #8486

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

grover-trilinos commented 3 years ago

Test results for issue #8486 as of 2021-04-04

Tests with issue trackers Failed: twif=2

Detailed test results: (click to expand)

Tests with issue trackers Failed: twif=2

Site Build Name Test Name Status Details Consec­utive Non-pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
stria Trilinos-atdm-van1-tx2_­arm-20.0_­openmpi-4.0.2_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 27 27 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.1_­openmpi-4.0.3_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 27 27 0 #8486

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

grover-trilinos commented 3 years ago

Test results for issue #8486 as of 2021-04-11

Tests with issue trackers Failed: twif=2

Detailed test results: (click to expand)

Tests with issue trackers Failed: twif=2

Site Build Name Test Name Status Details Consec­utive Non-pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
stria Trilinos-atdm-van1-tx2_­arm-20.0_­openmpi-4.0.2_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 30 30 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.1_­openmpi-4.0.3_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 30 30 0 #8486

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

grover-trilinos commented 3 years ago

Test results for issue #8486 as of 2021-04-18

Tests with issue trackers Failed: twif=2

Detailed test results: (click to expand)

Tests with issue trackers Failed: twif=2

Site Build Name Test Name Status Details Consec­utive Non-pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
stria Trilinos-atdm-van1-tx2_­arm-20.0_­openmpi-4.0.2_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 30 30 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.1_­openmpi-4.0.3_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 30 30 0 #8486

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

grover-trilinos commented 3 years ago

Test results for issue #8486 as of 2021-04-25

Tests with issue trackers Failed: twif=2

Detailed test results: (click to expand)

Tests with issue trackers Failed: twif=2

Site Build Name Test Name Status Details Consec­utive Non-pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
stria Trilinos-atdm-van1-tx2_­arm-20.0_­openmpi-4.0.2_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 30 30 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.1_­openmpi-4.0.3_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 30 30 0 #8486

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

grover-trilinos commented 3 years ago

Test results for issue #8486 as of 2021-05-02

Tests with issue trackers Failed: twif=2

Detailed test results: (click to expand)

Tests with issue trackers Failed: twif=2

Site Build Name Test Name Status Details Consec­utive Non-pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
stria Trilinos-atdm-van1-tx2_­arm-20.0_­openmpi-4.0.2_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 30 30 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.1_­openmpi-4.0.3_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 30 30 0 #8486

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

grover-trilinos commented 3 years ago

Test results for issue #8486 as of 2021-05-09

Tests with issue trackers Failed: twif=2

Detailed test results: (click to expand)

Tests with issue trackers Failed: twif=2

Site Build Name Test Name Status Details Consec­utive Non-pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
stria Trilinos-atdm-van1-tx2_­arm-20.0_­openmpi-4.0.2_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 30 30 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.1_­openmpi-4.0.3_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 30 30 0 #8486

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

grover-trilinos commented 3 years ago

Test results for issue #8486 as of 2021-05-30

Tests with issue trackers Failed: twif=2

Detailed test results: (click to expand)

Tests with issue trackers Failed: twif=2

Site Build Name Test Name Status Details Consec­utive Non-pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
stria Trilinos-atdm-van1-tx2_­arm-20.0_­openmpi-4.0.2_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 24 24 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.1_­openmpi-4.0.3_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 24 24 0 #8486

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

ccober6 commented 3 years ago

@trilinos/belos @srajama1 @hkthorn It appears that this is consistently failing. Can you take a look at it? Thanks!

grover-trilinos commented 3 years ago

Test results for issue #8486 as of 2021-06-06

Tests with issue trackers Failed: twif=2

Detailed test results: (click to expand)

Tests with issue trackers Failed: twif=2

Site Build Name Test Name Status Details Consec­utive Non-pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
stria Trilinos-atdm-van1-tx2_­arm-20.0_­openmpi-4.0.2_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 24 24 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.1_­openmpi-4.0.3_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 24 24 0 #8486

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

grover-trilinos commented 3 years ago

Test results for issue #8486 as of 2021-06-20

Tests with issue trackers Failed: twif=2

Detailed test results: (click to expand)

Tests with issue trackers Failed: twif=2

Site Build Name Test Name Status Details Consec­utive Non-pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
stria Trilinos-atdm-van1-tx2_­arm-20.0_­openmpi-4.0.2_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 24 24 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.1_­openmpi-4.0.3_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 24 24 0 #8486

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

ccober6 commented 3 years ago

@trilinos/belos @srajama1 @hkthorn Sorry, but do you have an update on this? Thanks!

grover-trilinos commented 3 years ago

Test results for issue #8486 as of 2021-06-27

Tests with issue trackers Failed: twif=2

Detailed test results: (click to expand)

Tests with issue trackers Failed: twif=2

Site Build Name Test Name Status Details Consec­utive Non-pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
stria Trilinos-atdm-van1-tx2_­arm-20.0_­openmpi-4.0.2_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 24 24 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.1_­openmpi-4.0.3_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 23 23 0 #8486

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

grover-trilinos commented 3 years ago

Test results for issue #8486 as of 2021-07-04

Tests with issue trackers Failed: twif=2

Detailed test results: (click to expand)

Tests with issue trackers Failed: twif=2

Site Build Name Test Name Status Details Consec­utive Non-pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
stria Trilinos-atdm-van1-tx2_­arm-20.0_­openmpi-4.0.2_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 23 23 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.1_­openmpi-4.0.3_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 22 22 0 #8486

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

grover-trilinos commented 3 years ago

Test results for issue #8486 as of 2021-07-11

Tests with issue trackers Failed: twif=2

Detailed test results: (click to expand)

Tests with issue trackers Failed: twif=2

Site Build Name Test Name Status Details Consec­utive Non-pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
stria Trilinos-atdm-van1-tx2_­arm-20.0_­openmpi-4.0.2_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 23 23 0 #8486
stria Trilinos-atdm-van1-tx2_­arm-20.1_­openmpi-4.0.3_­openmp_­static_­dbg Belos_­CustomSolverFactory_­MPI_­4 Failed Completed (Failed) 22 22 0 #8486

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

github-actions[bot] commented 2 years ago

This issue has had no activity for 365 days and is marked for closure. It will be closed after an additional 30 days of inactivity. If you would like to keep this issue open please add a comment and/or remove the MARKED_FOR_CLOSURE label. If this issue should be kept open even with no activity beyond the time limits you can add the label DO_NOT_AUTOCLOSE. If it is ok for this issue to be closed, feel free to go ahead and close it. Please do not add any comments or change any labels or otherwise touch this issue unless your intention is to reset the inactivity counter for an additional year.

github-actions[bot] commented 2 years ago

This issue was closed due to inactivity for 395 days.