search

sxs-collaboration / spectre

SpECTRE is a code for multi-scale, multi-physics problems in astrophysics and gravitational physics.
https://spectre-code.org
Other
154 stars 187 forks source link

Random failure of Unit.CurvedScalarWave.Worldtube.Iterations #6001

Open wthrowe opened 2 months ago

wthrowe commented 2 months ago 
2024-05-16T15:57:49.6696138Z Unit.CurvedScalarWave.Worldtube.Iterations
2024-05-16T15:57:49.6696982Z -------------------------------------------------------------------------------
2024-05-16T15:57:49.6698257Z ../../../../../../../tests/Unit/Evolution/Systems/CurvedScalarWave/Worldtube/ElementActions/Test_Iterations.cpp:413
2024-05-16T15:57:49.6699497Z ...............................................................................
2024-05-16T15:57:49.6699998Z 
2024-05-16T15:57:49.6700827Z ../../../../../../../tests/Unit/Evolution/Systems/CurvedScalarWave/Worldtube/ElementActions/Test_Iterations.cpp:354: FAILED:
2024-05-16T15:57:49.6702382Z   CHECK( get(self_force_inbox.at(dummy_time_step_id))[i] == self_force_acc.get(i) )
2024-05-16T15:57:49.6703253Z with expansion:
2024-05-16T15:57:49.6703656Z   nan == nan
2024-05-16T15:57:49.6704024Z with messages:
2024-05-16T15:57:49.6704440Z   max_iterations := 5
2024-05-16T15:57:49.6705114Z   Seed is: 311310335 from ../../../../../../../tests/Unit/Evolution/Systems/
2024-05-16T15:57:49.6706165Z   CurvedScalarWave/Worldtube/ElementActions/Test_Iterations.cpp:130
2024-05-16T15:57:49.6706967Z   expansion_order := 1
2024-05-16T15:57:49.6707448Z   worldtube_radius := 0.07000000000000001
2024-05-16T15:57:49.6708031Z   initial_refinement := 1
2024-05-16T15:57:49.6708499Z   current_iteration := 1
2024-05-16T15:57:49.6708812Z 
2024-05-16T15:57:49.6709669Z ../../../../../../../tests/Unit/Evolution/Systems/CurvedScalarWave/Worldtube/ElementActions/Test_Iterations.cpp:354: FAILED:
2024-05-16T15:57:49.6711228Z   CHECK( get(self_force_inbox.at(dummy_time_step_id))[i] == self_force_acc.get(i) )
2024-05-16T15:57:49.6712313Z with expansion:
2024-05-16T15:57:49.6712704Z   nan == nan
2024-05-16T15:57:49.6713069Z with messages:
2024-05-16T15:57:49.6713451Z   max_iterations := 5
2024-05-16T15:57:49.6714139Z   Seed is: 311310335 from ../../../../../../../tests/Unit/Evolution/Systems/
2024-05-16T15:57:49.6715166Z   CurvedScalarWave/Worldtube/ElementActions/Test_Iterations.cpp:130
2024-05-16T15:57:49.6715965Z   expansion_order := 1
2024-05-16T15:57:49.6716440Z   worldtube_radius := 0.07000000000000001
2024-05-16T15:57:49.6717005Z   initial_refinement := 1
2024-05-16T15:57:49.6717476Z   current_iteration := 1
2024-05-16T15:57:49.6717785Z

... and lots more of the same.

wthrowe commented 1 month ago

From #5997 

2024-05-22T00:32:10.3247619Z Unit.CurvedScalarWave.Worldtube.Iterations
2024-05-22T00:32:10.3248449Z -------------------------------------------------------------------------------
2024-05-22T00:32:10.3249692Z ../../../../../../../tests/Unit/Evolution/Systems/CurvedScalarWave/Worldtube/ElementActions/Test_Iterations.cpp:413
2024-05-22T00:32:10.3250904Z ...............................................................................
2024-05-22T00:32:10.3251404Z 
2024-05-22T00:32:10.3252241Z ../../../../../../../tests/Unit/Evolution/Systems/CurvedScalarWave/Worldtube/ElementActions/Test_Iterations.cpp:355: FAILED:
2024-05-22T00:32:10.3253735Z   CHECK( get(self_force_inbox.at(dummy_time_step_id))[i] == self_force_acc.get(i) )
2024-05-22T00:32:10.3254558Z with expansion:
2024-05-22T00:32:10.3254939Z   nan == nan
2024-05-22T00:32:10.3255302Z with messages:
2024-05-22T00:32:10.3255710Z   max_iterations := 2
2024-05-22T00:32:10.3256365Z   Seed is: 3463459746 from ../../../../../../../tests/Unit/Evolution/Systems/
2024-05-22T00:32:10.3257362Z   CurvedScalarWave/Worldtube/ElementActions/Test_Iterations.cpp:130
2024-05-22T00:32:10.3258494Z   expansion_order := 0
2024-05-22T00:32:10.3258962Z   worldtube_radius := 2.79999999999999982
2024-05-22T00:32:10.3259512Z   initial_refinement := 0
2024-05-22T00:32:10.3259961Z   current_iteration := 1
2024-05-22T00:32:10.3260257Z 
2024-05-22T00:32:10.3261096Z ../../../../../../../tests/Unit/Evolution/Systems/CurvedScalarWave/Worldtube/ElementActions/Test_Iterations.cpp:355: FAILED:
2024-05-22T00:32:10.3262581Z   CHECK( get(self_force_inbox.at(dummy_time_step_id))[i] == self_force_acc.get(i) )
2024-05-22T00:32:10.3263406Z with expansion:
2024-05-22T00:32:10.3263782Z   nan == nan
2024-05-22T00:32:10.3264144Z with messages:
2024-05-22T00:32:10.3264521Z   max_iterations := 2
2024-05-22T00:32:10.3265169Z   Seed is: 3463459746 from ../../../../../../../tests/Unit/Evolution/Systems/
2024-05-22T00:32:10.3266155Z   CurvedScalarWave/Worldtube/ElementActions/Test_Iterations.cpp:130
2024-05-22T00:32:10.3266920Z   expansion_order := 0
2024-05-22T00:32:10.3267390Z   worldtube_radius := 2.79999999999999982
2024-05-22T00:32:10.3267934Z   initial_refinement := 0
2024-05-22T00:32:10.3268389Z   current_iteration := 1