## Description
As shown in [this query](https://testing-dev.sandia.gov/cdash/queryTests.php?project=Trilinos&begin=2020-07-21&end=2021-01-19&filtercount=4&showfilters=1&filtercombine=and&field1=groupname&compare1=62&value1=Experimental&field2=buildname&compare2=65&value2=Trilinos-atdm-&field3=status&compare3=62&value3=passed&field4=testoutput&compare4=95&value4=Consistency%20error) (click "Shown Matching Output" in upper right) the tests:
* `ROL_example_PDE-OPT_stefan-boltzmann_example_01_MPI_4`
* `ROL_example_tempus_example_02_MPI_1`
* `ROL_test_sol_checkSuperQuantileQuadrangle_MPI_1`
* `ROL_test_vector_StdArrayInterface_MPI_1`
in the builds:
* `Trilinos-atdm-ats1-knl_intel-19.0.4_mpich-7.7.15_openmp_static_opt`
* `Trilinos-atdm-ats1-knl_intel-19.0.4_mpich-7.7.6_openmp_static_opt`
* `Trilinos-atdm-ats2-gnu-7.3.1-spmpi-rolling_serial_static_dbg`
* `Trilinos-atdm-cts1-intel-19.0.4_openmpi-4.0.3_openmp_static_dbg`
* `Trilinos-atdm-cts1-intel-19.0.4_openmpi-4.0.3_openmp_static_opt`
* `Trilinos-atdm-van1-tx2_arm-20.0_openmpi-4.0.2_openmp_static_dbg`
* `Trilinos-atdm-van1-tx2_arm-20.1_openmpi-4.0.3_openmp_static_dbg`
started failing on testing day 2020-07-22.
Related to https://github.com/trilinos/Trilinos/issues/8486 and https://github.com/trilinos/Trilinos/issues/6553.
As shown in https://testing-dev.sandia.gov/cdash/test/41294765, https://testing-dev.sandia.gov/cdash/test/41266187, https://testing-dev.sandia.gov/cdash/test/25915010, and https://testing-dev.sandia.gov/cdash/test/28236759 we are seeing errors like:
```
********** Begin verification of linear algebra. *********************************************
Commutativity of addition. Consistency error: >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 0.000000000000e+00
Associativity of addition. Consistency error: >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 2.719479911021e-16
Identity element of addition. Consistency error: >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 0.000000000000e+00
Inverse elements of addition. Consistency error: >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 0.000000000000e+00
Identity element of scalar multiplication. Consistency error: >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 0.000000000000e+00
Consistency of scalar multiplication with field multiplication. Consistency error: >>>>>>>>>>> 2.623306862686e-16
Distributivity of scalar multiplication with respect to field addition. Consistency error: >>> 5.644999164097e-16
Distributivity of scalar multiplication with respect to vector addition. Consistency error: >> 7.485252198913e-16
Commutativity of dot (inner) product over the field of reals. Consistency error: >>>>>>>>>>>>> 0.000000000000e+00
Additivity of dot (inner) product. Consistency error: >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 0.000000000000e+00
Consistency of scalar multiplication and norm. Consistency error: >>>>>>>>>>>>>>>>>>>>>>>>>>>> 0.000000000000e+00
Reflexivity. Consistency error: >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 0.000000000000e+00
```
## Current Status on CDash
Run the [above query](https://testing-dev.sandia.gov/cdash/queryTests.php?project=Trilinos&begin=2020-07-21&end=2021-01-19&filtercount=4&showfilters=1&filtercombine=and&field1=groupname&compare1=62&value1=Experimental&field2=buildname&compare2=65&value2=Trilinos-atdm-&field3=status&compare3=62&value3=passed&field4=testoutput&compare4=95&value4=Consistency%20error) adjusting the "Begin" and "End" dates to match today any other date range or just click "CURRENT" in the top bar to see results for the current testing day.
## Steps to Reproduce
One should be able to reproduce this failure as described in:
* https://github.com/trilinos/Trilinos/blob/develop/cmake/std/atdm/README.md
and the system-specific instructions at:
* https://github.com/trilinos/Trilinos/blob/develop/cmake/std/atdm/README.md#specific-instructions-for-each-system
Just log into any of the associated machines and copy and paste the full CDash build name `` listed above and run commands like:
```
$ cd /
$ source $TRILINOS_DIR/cmake/std/atdm/load-env.sh
$ cmake \
-GNinja \
-DTrilinos_CONFIGURE_OPTIONS_FILE:STRING=cmake/std/atdm/ATDMDevEnv.cmake \
-DTrilinos_ENABLE_TESTS=ON -DTrilinos_ENABLE_=ON \
$TRILINOS_DIR
$ make NP=16
$ ctest -j4
```
where `` is any package that you want to enable to reproduce build and/or test results.
Again, for exact system-specific details on what commands to run to build and run tests, see:
* https://github.com/trilinos/Trilinos/blob/develop/cmake/std/atdm/README.md#specific-instructions-for-each-system
If you can't figure out what commands to run to reproduce the problem given this documentation, then please post a comment here and we will give you the exact minimal commands.
CC: @trilinos/rol, @rppawlo, @jwillenbring, @bartlettroscoe
Next Action Status