search

ECP-WarpX / WarpX

WarpX is an advanced electromagnetic & electrostatic Particle-In-Cell code.
https://ecp-warpx.github.io
Other
294 stars 190 forks source link

Test failures when sorting particles is enabled #2981

Open PhilMiller opened 2 years ago

PhilMiller commented 2 years ago

Based on observed failures in #2692 that went away when I avoided actually sorting the particles every step, I decided to run the tests with sorting enabled to apply every step, and no other changes:

$ git diff
diff --git a/Source/WarpX.cpp b/Source/WarpX.cpp
index ca7a36d1..bedfca21 100644
--- a/Source/WarpX.cpp
+++ b/Source/WarpX.cpp
@@ -994,7 +994,7 @@ WarpX::ReadParameters ()
         std::vector<std::string> lasers_names;
         pp_lasers.queryarr("names", lasers_names);

-        std::vector<std::string> sort_intervals_string_vec = {"-1"};
+        std::vector<std::string> sort_intervals_string_vec = {"1"};
         if (!species_names.empty() || !lasers_names.empty()) {
             int particle_shape;
             if (queryWithParser(pp_algo, "particle_shape", particle_shape) == false)
@@ -1028,7 +1028,7 @@ WarpX::ReadParameters ()
 #ifdef AMREX_USE_GPU
             sort_intervals_string_vec = {"4"};
 #else
-            sort_intervals_string_vec = {"-1"};
+            sort_intervals_string_vec = {"1"};
 #endif
         }

I do indeed observe some failures resulting from this

PhilMiller commented 2 years ago 
configuring Langmuir_multi_2d_MR_anisotropic build...
   mkdir /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-uOufDtmZ3c/warpx/builddir
   cmake  -DAMReX_ASSERTIONS=ON -DAMReX_TESTING=ON -DWarpX_DIMS=2 -S /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-uOufDtmZ3c/warpx/ -B /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-uOufDtmZ3c/warpx/builddir 

building Langmuir_multi_2d_MR_anisotropic...
   cmake --build /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-uOufDtmZ3c/warpx/builddir -j 8 --  
   Compilation time: 11.352 s
   run & test directory: /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-uOufDtmZ3c/rt-WarpX/WarpX-tests/2022-03-17/Langmuir_multi_2d_MR_anisotropic/
   copying files to run directory...
   path to input file: Examples/Tests/Langmuir/inputs_2d_multi_rt
   running the test...
   mpiexec -n 2 ./Langmuir_multi_2d_MR_anisotropic.ex inputs_2d_multi_rt  diag1.file_prefix=Langmuir_multi_2d_MR_anisotropic_plt   amrex.abort_on_unused_inputs=1 amrex.fpe_trap_invalid=1 amrex.fpe_trap_zero=1 amrex.fpe_trap_overflow=1 warpx.always_warn_immediately=1 warpx.abort_on_warning_threshold=low algo.maxwell_solver = ckc  warpx.use_filter = 1  amr.max_level = 1 amr.ref_ratio_vect = 4 2 warpx.fine_tag_lo = -10.e-6 -10.e-6  warpx.fine_tag_hi = 10.e-6 10.e-6  diag1.electrons.variables = w ux uy uz  diag1.positrons.variables = w ux uy uz
   Execution time: 1.765 s
   WARNING: unable to open the job_info file
   doing the analysis...
   WARNING: analysis failed...
./analysis_langmuir_multi_2d.py  Langmuir_multi_2d_MR_anisotropic_plt000080
Ex: Max error: 2.58e-02
Ez: Max error: 2.81e-02
error_rel    : 0.028091263438578425
tolerance_rel: 0.05
ERROR: Benchmark and plotfile checksum have different value for key [lev=1,By]
Benchmark: [lev=1,By] 7.534189668301649e+01
Plotfile : [lev=1,By] 7.770248576226740e+01
Absolute error: 2.36e+00
Relative error: 3.13e-02
ERROR: Benchmark and plotfile checksum have different value for key [lev=1,Ex]
Benchmark: [lev=1,Ex] 4.601932334532539e+12
Plotfile : [lev=1,Ex] 4.688677353430061e+12
Absolute error: 8.67e+10
Relative error: 1.88e-02
ERROR: Benchmark and plotfile checksum have different value for key [lev=1,Ez]
Benchmark: [lev=1,Ez] 7.011970862051691e+12
Plotfile : [lev=1,Ez] 7.044692562765166e+12
Absolute error: 3.27e+10
Relative error: 4.67e-03
ERROR: Benchmark and plotfile checksum have different value for key [lev=1,jx]
Benchmark: [lev=1,jx] 4.494391278293100e+15
Plotfile : [lev=1,jx] 4.578774062169941e+15
Absolute error: 8.44e+13
Relative error: 1.88e-02
ERROR: Benchmark and plotfile checksum have different value for key [lev=1,jz]
Benchmark: [lev=1,jz] 6.848792132928508e+15
Plotfile : [lev=1,jz] 6.880679162427368e+15
Absolute error: 3.19e+13
Relative error: 4.66e-03

   WARNING: unable to copy analysis image
   archiving the output...
   creating problem test report ...
   Langmuir_multi_2d_MR_anisotropic FAILED
PhilMiller commented 2 years ago 
configuring background_mcc build...
   mkdir /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-w2JttF9Luj/warpx/builddir
   cmake  -DAMReX_ASSERTIONS=ON -DAMReX_TESTING=ON -DWarpX_DIMS=2 -S /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-w2JttF9Luj/warpx/ -B /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-w2JttF9Luj/warpx/builddir 

building background_mcc...
   cmake --build /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-w2JttF9Luj/warpx/builddir -j 8 --  
   Compilation time: 99.169 s
   run & test directory: /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-w2JttF9Luj/rt-WarpX/WarpX-tests/2022-03-17/background_mcc/
   copying files to run directory...
   path to input file: Examples/Physics_applications/capacitive_discharge/inputs_2d
   running the test...
   mpiexec -n 2 ./background_mcc.ex inputs_2d  diag1.file_prefix=background_mcc_plt   amrex.abort_on_unused_inputs=1 amrex.fpe_trap_invalid=1 amrex.fpe_trap_zero=1 amrex.fpe_trap_overflow=1 warpx.always_warn_immediately=1 warpx.abort_on_warning_threshold=low warpx.abort_on_warning_threshold = high
   Execution time: 4.741 s
   WARNING: unable to open the job_info file
   doing the analysis...
   WARNING: analysis failed...
./analysis_default_regression.py  background_mcc_plt000050
ERROR: Benchmark and plotfile checksum have different value for key [electrons,particle_cpu]
Benchmark: [electrons,particle_cpu] 1.873580000000000e+05
Plotfile : [electrons,particle_cpu] 1.873870000000000e+05
Absolute error: 2.90e+01
Relative error: 1.55e-04
ERROR: Benchmark and plotfile checksum have different value for key [electrons,particle_id]
Benchmark: [electrons,particle_id] 5.819970373100000e+10
Plotfile : [electrons,particle_id] 5.823441382700000e+10
Absolute error: 3.47e+07
Relative error: 5.96e-04
ERROR: Benchmark and plotfile checksum have different value for key [electrons,particle_momentum_x]
Benchmark: [electrons,particle_momentum_x] 1.014100180873032e-18
Plotfile : [electrons,particle_momentum_x] 1.013852337938759e-18
Absolute error: 2.48e-22
Relative error: 2.44e-04
ERROR: Benchmark and plotfile checksum have different value for key [electrons,particle_momentum_y]
Benchmark: [electrons,particle_momentum_y] 2.807097717159238e-19
Plotfile : [electrons,particle_momentum_y] 2.810171580467493e-19
Absolute error: 3.07e-22
Relative error: 1.10e-03
ERROR: Benchmark and plotfile checksum have different value for key [electrons,particle_momentum_z]
Benchmark: [electrons,particle_momentum_z] 2.802904932956506e-19
Plotfile : [electrons,particle_momentum_z] 2.807239605427769e-19
Absolute error: 4.33e-22
Relative error: 1.55e-03
ERROR: Benchmark and plotfile checksum have different value for key [electrons,particle_position_x]
Benchmark: [electrons,particle_position_x] 1.712802584618672e+04
Plotfile : [electrons,particle_position_x] 1.713075581287373e+04
Absolute error: 2.73e+00
Relative error: 1.59e-04
ERROR: Benchmark and plotfile checksum have different value for key [electrons,particle_position_y]
Benchmark: [electrons,particle_position_y] 9.336068577115554e+02
Plotfile : [electrons,particle_position_y] 9.329240519399486e+02
Absolute error: 6.83e-01
Relative error: 7.31e-04
ERROR: Benchmark and plotfile checksum have different value for key [electrons,particle_weight]
Benchmark: [electrons,particle_weight] 6.109851208496095e+10
Plotfile : [electrons,particle_weight] 6.110851260375977e+10
Absolute error: 1.00e+07
Relative error: 1.64e-04
ERROR: Benchmark and plotfile checksum have different value for key [he_ions,particle_cpu]
Benchmark: [he_ions,particle_cpu] 2.627970000000000e+05
Plotfile : [he_ions,particle_cpu] 2.628200000000000e+05
Absolute error: 2.30e+01
Relative error: 8.75e-05
ERROR: Benchmark and plotfile checksum have different value for key [he_ions,particle_id]
Benchmark: [he_ions,particle_id] 2.067133375540000e+11
Plotfile : [he_ions,particle_id] 2.067440740330000e+11
Absolute error: 3.07e+07
Relative error: 1.49e-04
ERROR: Benchmark and plotfile checksum have different value for key [he_ions,particle_momentum_x]
Benchmark: [he_ions,particle_momentum_x] 2.887261723355975e-18
Plotfile : [he_ions,particle_momentum_x] 2.887993185566875e-18
Absolute error: 7.31e-22
Relative error: 2.53e-04
ERROR: Benchmark and plotfile checksum have different value for key [he_ions,particle_momentum_y]
Benchmark: [he_ions,particle_momentum_y] 2.194552440370878e-18
Plotfile : [he_ions,particle_momentum_y] 2.194908510859530e-18
Absolute error: 3.56e-22
Relative error: 1.62e-04
ERROR: Benchmark and plotfile checksum have different value for key [he_ions,particle_momentum_z]
Benchmark: [he_ions,particle_momentum_z] 2.198247159565895e-18
Plotfile : [he_ions,particle_momentum_z] 2.198252117397157e-18
Absolute error: 4.96e-24
Relative error: 2.26e-06
ERROR: Benchmark and plotfile checksum have different value for key [he_ions,particle_position_x]
Benchmark: [he_ions,particle_position_x] 1.760541372853014e+04
Plotfile : [he_ions,particle_position_x] 1.760676858386424e+04
Absolute error: 1.35e+00
Relative error: 7.70e-05
ERROR: Benchmark and plotfile checksum have different value for key [he_ions,particle_position_y]
Benchmark: [he_ions,particle_position_y] 1.099846221252218e+03
Plotfile : [he_ions,particle_position_y] 1.099995278184533e+03
Absolute error: 1.49e-01
Relative error: 1.36e-04
ERROR: Benchmark and plotfile checksum have different value for key [he_ions,particle_weight]
Benchmark: [he_ions,particle_weight] 7.196578817749025e+10
Plotfile : [he_ions,particle_weight] 7.197387078857423e+10
Absolute error: 8.08e+06
Relative error: 1.12e-04
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,rho_electrons]
Benchmark: [lev=0,rho_electrons] 3.565181759350067e-02
Plotfile : [lev=0,rho_electrons] 3.566102987786449e-02
Absolute error: 9.21e-06
Relative error: 2.58e-04
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,rho_he_ions]
Benchmark: [lev=0,rho_he_ions] 4.191959356643796e-02
Plotfile : [lev=0,rho_he_ions] 4.192413601773830e-02
Absolute error: 4.54e-06
Relative error: 1.08e-04

   WARNING: unable to copy analysis image
   archiving the output...
   creating problem test report ...
   background_mcc FAILED
PhilMiller commented 2 years ago 
configuring LaserAccelerationBoost build...
   mkdir /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-WL26tpAmPi/warpx/builddir
   cmake  -DAMReX_ASSERTIONS=ON -DAMReX_TESTING=ON -DWarpX_DIMS=2 -S /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-WL26tpAmPi/warpx/ -B /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-WL26tpAmPi/warpx/builddir 

building LaserAccelerationBoost...
   cmake --build /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-WL26tpAmPi/warpx/builddir -j 8 --  
   Compilation time: 11.291 s
   run & test directory: /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-WL26tpAmPi/rt-WarpX/WarpX-tests/2022-03-17/LaserAccelerationBoost/
   copying files to run directory...
   path to input file: Examples/Physics_applications/laser_acceleration/inputs_2d_boost
   running the test...
   mpiexec -n 2 ./LaserAccelerationBoost.ex inputs_2d_boost  diag1.file_prefix=LaserAccelerationBoost_plt   amrex.abort_on_unused_inputs=1 amrex.fpe_trap_invalid=1 amrex.fpe_trap_zero=1 amrex.fpe_trap_overflow=1 warpx.always_warn_immediately=1 warpx.abort_on_warning_threshold=low warpx.do_dynamic_scheduling=0 warpx.serialize_initial_conditions=1 amr.n_cell=64 512 max_step=20
   Execution time: 0.397 s
   WARNING: unable to open the job_info file
   doing the analysis...
   WARNING: analysis failed...
./analysis_default_regression.py  LaserAccelerationBoost_plt000020
ERROR: Benchmark and plotfile checksum have different value for key [beam,particle_momentum_x]
Benchmark: [beam,particle_momentum_x] 4.404628909253640e-19
Plotfile : [beam,particle_momentum_x] 4.200776992212792e-19
Absolute error: 2.04e-20
Relative error: 4.63e-02
ERROR: Benchmark and plotfile checksum have different value for key [beam,particle_momentum_y]
Benchmark: [beam,particle_momentum_y] 4.375137239523109e-19
Plotfile : [beam,particle_momentum_y] 4.394664070532029e-19
Absolute error: 1.95e-21
Relative error: 4.46e-03
ERROR: Benchmark and plotfile checksum have different value for key [beam,particle_momentum_z]
Benchmark: [beam,particle_momentum_z] 2.680882004211874e-18
Plotfile : [beam,particle_momentum_z] 2.682590816422328e-18
Absolute error: 1.71e-21
Relative error: 6.37e-04
ERROR: Benchmark and plotfile checksum have different value for key [beam,particle_position_x]
Benchmark: [beam,particle_position_x] 8.126719835048633e-04
Plotfile : [beam,particle_position_x] 7.849560738605996e-04
Absolute error: 2.77e-05
Relative error: 3.41e-02
ERROR: Benchmark and plotfile checksum have different value for key [beam,particle_position_y]
Benchmark: [beam,particle_position_y] 3.596147573048867e-01
Plotfile : [beam,particle_position_y] 3.598875384583006e-01
Absolute error: 2.73e-04
Relative error: 7.59e-04
ERROR: Benchmark and plotfile checksum have different value for key [ions,particle_momentum_x]
Benchmark: [ions,particle_momentum_x] 7.729986759772206e-30
Plotfile : [ions,particle_momentum_x] 7.729986901681364e-30
Absolute error: 1.42e-37
Relative error: 1.84e-08
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Bx]
Benchmark: [lev=0,Bx] 7.184641132345461e+03
Plotfile : [lev=0,Bx] 7.184494983577415e+03
Absolute error: 1.46e-01
Relative error: 2.03e-05
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,By]
Benchmark: [lev=0,By] 1.642963921486140e+01
Plotfile : [lev=0,By] 1.644205095959012e+01
Absolute error: 1.24e-02
Relative error: 7.55e-04
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Bz]
Benchmark: [lev=0,Bz] 4.259213641032898e+02
Plotfile : [lev=0,Bz] 4.257929692502738e+02
Absolute error: 1.28e-01
Relative error: 3.01e-04
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Ex]
Benchmark: [lev=0,Ex] 4.509329694688026e+09
Plotfile : [lev=0,Ex] 4.525475038659193e+09
Absolute error: 1.61e+07
Relative error: 3.58e-03
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Ey]
Benchmark: [lev=0,Ey] 1.984276461005905e+12
Plotfile : [lev=0,Ey] 1.984229397478474e+12
Absolute error: 4.71e+07
Relative error: 2.37e-05
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Ez]
Benchmark: [lev=0,Ez] 6.310104620908310e+09
Plotfile : [lev=0,Ez] 6.325609351347007e+09
Absolute error: 1.55e+07
Relative error: 2.46e-03
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,jx]
Benchmark: [lev=0,jx] 4.752150599756195e+09
Plotfile : [lev=0,jx] 3.719087158485150e+09
Absolute error: 1.03e+09
Relative error: 2.17e-01
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,jy]
Benchmark: [lev=0,jy] 5.539208925295011e+14
Plotfile : [lev=0,jy] 5.539175784726591e+14
Absolute error: 3.31e+09
Relative error: 5.98e-06
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,jz]
Benchmark: [lev=0,jz] 4.503628377644352e+11
Plotfile : [lev=0,jz] 4.506485022710943e+11
Absolute error: 2.86e+08
Relative error: 6.34e-04

   WARNING: unable to copy analysis image
   archiving the output...
   creating problem test report ...
   LaserAccelerationBoost FAILED
PhilMiller commented 2 years ago 
configuring LaserAccelerationMR build...
   mkdir /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-WL26tpAmPi/warpx/builddir
   cmake  -DAMReX_ASSERTIONS=ON -DAMReX_TESTING=ON -DWarpX_DIMS=2 -S /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-WL26tpAmPi/warpx/ -B /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-WL26tpAmPi/warpx/builddir 

building LaserAccelerationMR...
   cmake --build /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-WL26tpAmPi/warpx/builddir -j 8 --  
   Compilation time: 11.707 s
   run & test directory: /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-WL26tpAmPi/rt-WarpX/WarpX-tests/2022-03-17/LaserAccelerationMR/
   copying files to run directory...
   path to input file: Examples/Physics_applications/laser_acceleration/inputs_2d
   running the test...
   mpiexec -n 2 ./LaserAccelerationMR.ex inputs_2d  diag1.file_prefix=LaserAccelerationMR_plt   amrex.abort_on_unused_inputs=1 amrex.fpe_trap_invalid=1 amrex.fpe_trap_zero=1 amrex.fpe_trap_overflow=1 warpx.always_warn_immediately=1 warpx.abort_on_warning_threshold=low
   Execution time: 1.662 s
   WARNING: unable to open the job_info file
   doing the analysis...
   WARNING: analysis failed...
./analysis_default_regression.py  LaserAccelerationMR_plt000200
ERROR: Benchmark and plotfile checksum have different value for key [beam,particle_momentum_x]
Benchmark: [beam,particle_momentum_x] 4.561019131383119e-20
Plotfile : [beam,particle_momentum_x] 4.192046868892079e-20
Absolute error: 3.69e-21
Relative error: 8.09e-02
ERROR: Benchmark and plotfile checksum have different value for key [beam,particle_momentum_y]
Benchmark: [beam,particle_momentum_y] 4.149842919134552e-20
Plotfile : [beam,particle_momentum_y] 4.190980902270850e-20
Absolute error: 4.11e-22
Relative error: 9.91e-03
ERROR: Benchmark and plotfile checksum have different value for key [beam,particle_momentum_z]
Benchmark: [beam,particle_momentum_z] 1.364708476750903e-17
Plotfile : [beam,particle_momentum_z] 1.368235096169660e-17
Absolute error: 3.53e-20
Relative error: 2.58e-03
ERROR: Benchmark and plotfile checksum have different value for key [beam,particle_position_x]
Benchmark: [beam,particle_position_x] 4.652770082118157e-05
Plotfile : [beam,particle_position_x] 3.654577686945539e-05
Absolute error: 9.98e-06
Relative error: 2.15e-01
ERROR: Benchmark and plotfile checksum have different value for key [beam,particle_position_y]
Benchmark: [beam,particle_position_y] 1.484501913502292e-03
Plotfile : [beam,particle_position_y] 1.486847661880174e-03
Absolute error: 2.35e-06
Relative error: 1.58e-03
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Bx]
Benchmark: [lev=0,Bx] 2.412159502471585e+07
Plotfile : [lev=0,Bx] 2.412163144804224e+07
Absolute error: 3.64e+01
Relative error: 1.51e-06
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,By]
Benchmark: [lev=0,By] 7.823213397859206e+04
Plotfile : [lev=0,By] 7.851835029384716e+04
Absolute error: 2.86e+02
Relative error: 3.66e-03
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Bz]
Benchmark: [lev=0,Bz] 6.010585314543134e+05
Plotfile : [lev=0,Bz] 6.010672039438927e+05
Absolute error: 8.67e+00
Relative error: 1.44e-05
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Ex]
Benchmark: [lev=0,Ex] 2.286576669849482e+13
Plotfile : [lev=0,Ex] 2.304591793715062e+13
Absolute error: 1.80e+11
Relative error: 7.88e-03
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Ey]
Benchmark: [lev=0,Ey] 6.508549201873332e+15
Plotfile : [lev=0,Ey] 6.508559814721992e+15
Absolute error: 1.06e+10
Relative error: 1.63e-06
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Ez]
Benchmark: [lev=0,Ez] 3.207253401795055e+13
Plotfile : [lev=0,Ez] 3.216064715636137e+13
Absolute error: 8.81e+10
Relative error: 2.75e-03
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,jx]
Benchmark: [lev=0,jx] 1.130516319665756e+15
Plotfile : [lev=0,jx] 1.130899236009832e+15
Absolute error: 3.83e+11
Relative error: 3.39e-04
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,jy]
Benchmark: [lev=0,jy] 2.325136305137274e+18
Plotfile : [lev=0,jy] 2.325138469636050e+18
Absolute error: 2.16e+12
Relative error: 9.31e-07
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,jz]
Benchmark: [lev=0,jz] 6.769519391624705e+15
Plotfile : [lev=0,jz] 6.769518372986051e+15
Absolute error: 1.02e+09
Relative error: 1.50e-07
ERROR: Benchmark and plotfile checksum have different value for key [lev=1,Bx]
Benchmark: [lev=1,Bx] 5.330328078531405e+07
Plotfile : [lev=1,Bx] 5.330342641673832e+07
Absolute error: 1.46e+02
Relative error: 2.73e-06
ERROR: Benchmark and plotfile checksum have different value for key [lev=1,By]
Benchmark: [lev=1,By] 2.138203084522391e+05
Plotfile : [lev=1,By] 2.149377899113423e+05
Absolute error: 1.12e+03
Relative error: 5.23e-03
ERROR: Benchmark and plotfile checksum have different value for key [lev=1,Bz]
Benchmark: [lev=1,Bz] 1.321618978929098e+06
Plotfile : [lev=1,Bz] 1.321661676496568e+06
Absolute error: 4.27e+01
Relative error: 3.23e-05
ERROR: Benchmark and plotfile checksum have different value for key [lev=1,Ex]
Benchmark: [lev=1,Ex] 4.784601938862305e+13
Plotfile : [lev=1,Ex] 4.822748180841591e+13
Absolute error: 3.81e+11
Relative error: 7.97e-03
ERROR: Benchmark and plotfile checksum have different value for key [lev=1,Ey]
Benchmark: [lev=1,Ey] 1.455101409934242e+16
Plotfile : [lev=1,Ey] 1.455105891411762e+16
Absolute error: 4.48e+10
Relative error: 3.08e-06
ERROR: Benchmark and plotfile checksum have different value for key [lev=1,Ez]
Benchmark: [lev=1,Ez] 6.530450277587459e+13
Plotfile : [lev=1,Ez] 6.513517097195845e+13
Absolute error: 1.69e+11
Relative error: 2.59e-03
ERROR: Benchmark and plotfile checksum have different value for key [lev=1,jx]
Benchmark: [lev=1,jx] 4.616927432401600e+13
Plotfile : [lev=1,jx] 4.737212089838120e+13
Absolute error: 1.20e+12
Relative error: 2.61e-02
ERROR: Benchmark and plotfile checksum have different value for key [lev=1,jy]
Benchmark: [lev=1,jy] 9.274837523569297e+18
Plotfile : [lev=1,jy] 9.274848044554465e+18
Absolute error: 1.05e+13
Relative error: 1.13e-06
ERROR: Benchmark and plotfile checksum have different value for key [lev=1,jz]
Benchmark: [lev=1,jz] 1.926277235505425e+16
Plotfile : [lev=1,jz] 1.926276828049964e+16
Absolute error: 4.07e+09
Relative error: 2.12e-07

   WARNING: unable to copy analysis image
   archiving the output...
   creating problem test report ...
   LaserAccelerationMR FAILED
PhilMiller commented 2 years ago 
configuring LaserAccelerationRZ build...
   mkdir /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-WL26tpAmPi/warpx/builddir
   cmake  -DAMReX_ASSERTIONS=ON -DAMReX_TESTING=ON -DWarpX_DIMS=RZ -S /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-WL26tpAmPi/warpx/ -B /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-WL26tpAmPi/warpx/builddir 

building LaserAccelerationRZ...
   cmake --build /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-WL26tpAmPi/warpx/builddir -j 8 --  
   Compilation time: 61.114 s
   run & test directory: /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-WL26tpAmPi/rt-WarpX/WarpX-tests/2022-03-17/LaserAccelerationRZ/
   copying files to run directory...
   path to input file: Examples/Physics_applications/laser_acceleration/inputs_rz
   running the test...
   mpiexec -n 2 ./LaserAccelerationRZ.ex inputs_rz  diag1.file_prefix=LaserAccelerationRZ_plt   amrex.abort_on_unused_inputs=1 amrex.fpe_trap_invalid=1 amrex.fpe_trap_zero=1 amrex.fpe_trap_overflow=1 warpx.always_warn_immediately=1 warpx.abort_on_warning_threshold=low
   Execution time: 0.529 s
   WARNING: unable to open the job_info file
   doing the analysis...
   WARNING: analysis failed...
./analysis_default_regression.py  LaserAccelerationRZ_plt000010
ERROR: Benchmark and plotfile checksum have different value for key [beam,particle_momentum_x]
Benchmark: [beam,particle_momentum_x] 3.880109055649298e-20
Plotfile : [beam,particle_momentum_x] 3.889984313780153e-20
Absolute error: 9.88e-23
Relative error: 2.55e-03
ERROR: Benchmark and plotfile checksum have different value for key [beam,particle_momentum_y]
Benchmark: [beam,particle_momentum_y] 5.078193010383020e-20
Plotfile : [beam,particle_momentum_y] 3.956110640425010e-20
Absolute error: 1.12e-20
Relative error: 2.21e-01
ERROR: Benchmark and plotfile checksum have different value for key [beam,particle_momentum_z]
Benchmark: [beam,particle_momentum_z] 1.350360849468085e-17
Plotfile : [beam,particle_momentum_z] 1.373718745897672e-17
Absolute error: 2.34e-19
Relative error: 1.73e-02
ERROR: Benchmark and plotfile checksum have different value for key [beam,particle_position_x]
Benchmark: [beam,particle_position_x] 6.242131236443886e-05
Plotfile : [beam,particle_position_x] 5.887149839735400e-05
Absolute error: 3.55e-06
Relative error: 5.69e-02
ERROR: Benchmark and plotfile checksum have different value for key [beam,particle_position_y]
Benchmark: [beam,particle_position_y] 2.676436329697945e-03
Plotfile : [beam,particle_position_y] 2.681656100941019e-03
Absolute error: 5.22e-06
Relative error: 1.95e-03
ERROR: Benchmark and plotfile checksum have different value for key [beam,particle_theta]
Benchmark: [beam,particle_theta] 1.514079870868123e+02
Plotfile : [beam,particle_theta] 1.573725239504061e+02
Absolute error: 5.96e+00
Relative error: 3.94e-02
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Br_0_real]
Benchmark: [lev=0,Br_0_real] 3.635664913519392e-01
Plotfile : [lev=0,Br_0_real] 6.638620582398957e-01
Absolute error: 3.00e-01
Relative error: 8.26e-01
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Br_1_imag]
Benchmark: [lev=0,Br_1_imag] 1.154188674892080e+02
Plotfile : [lev=0,Br_1_imag] 1.180308684092975e+02
Absolute error: 2.61e+00
Relative error: 2.26e-02
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Br_1_real]
Benchmark: [lev=0,Br_1_real] 1.422580196553699e+05
Plotfile : [lev=0,Br_1_real] 1.422557021933990e+05
Absolute error: 2.32e+00
Relative error: 1.63e-05
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Btheta_0_real]
Benchmark: [lev=0,Btheta_0_real] 1.299881672173312e+03
Plotfile : [lev=0,Btheta_0_real] 1.377564097137902e+03
Absolute error: 7.77e+01
Relative error: 5.98e-02
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Btheta_1_imag]
Benchmark: [lev=0,Btheta_1_imag] 1.433180445665896e+05
Plotfile : [lev=0,Btheta_1_imag] 1.432923785148314e+05
Absolute error: 2.57e+01
Relative error: 1.79e-04
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Btheta_1_real]
Benchmark: [lev=0,Btheta_1_real] 1.553777483302437e+02
Plotfile : [lev=0,Btheta_1_real] 1.707111462883403e+02
Absolute error: 1.53e+01
Relative error: 9.87e-02
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Bx]
Benchmark: [lev=0,Bx] 1.422580131907655e+05
Plotfile : [lev=0,Bx] 1.422557738365847e+05
Absolute error: 2.24e+00
Relative error: 1.57e-05
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,By]
Benchmark: [lev=0,By] 1.301569526356756e+03
Plotfile : [lev=0,By] 1.380843589387006e+03
Absolute error: 7.93e+01
Relative error: 6.09e-02
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Bz]
Benchmark: [lev=0,Bz] 5.993640969075834e+03
Plotfile : [lev=0,Bz] 5.993795470596700e+03
Absolute error: 1.55e-01
Relative error: 2.58e-05
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Bz_0_real]
Benchmark: [lev=0,Bz_0_real] 4.737412745527051e-01
Plotfile : [lev=0,Bz_0_real] 6.385722734447393e-01
Absolute error: 1.65e-01
Relative error: 3.48e-01
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Bz_1_imag]
Benchmark: [lev=0,Bz_1_imag] 1.140995649338472e+00
Plotfile : [lev=0,Bz_1_imag] 6.161430761976008e-01
Absolute error: 5.25e-01
Relative error: 4.60e-01
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Bz_1_real]
Benchmark: [lev=0,Bz_1_real] 5.993528898267216e+03
Plotfile : [lev=0,Bz_1_real] 5.993646686379238e+03
Absolute error: 1.18e-01
Relative error: 1.97e-05
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Er_0_real]
Benchmark: [lev=0,Er_0_real] 2.761795755400639e+11
Plotfile : [lev=0,Er_0_real] 3.127560509036077e+11
Absolute error: 3.66e+10
Relative error: 1.32e-01
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Er_1_imag]
Benchmark: [lev=0,Er_1_imag] 4.791136785837188e+13
Plotfile : [lev=0,Er_1_imag] 4.791312389482411e+13
Absolute error: 1.76e+09
Relative error: 3.67e-05
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Er_1_real]
Benchmark: [lev=0,Er_1_real] 4.690059853603668e+10
Plotfile : [lev=0,Er_1_real] 5.337909999000079e+10
Absolute error: 6.48e+09
Relative error: 1.38e-01
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Etheta_0_real]
Benchmark: [lev=0,Etheta_0_real] 1.358681217945822e+08
Plotfile : [lev=0,Etheta_0_real] 2.193056379111399e+08
Absolute error: 8.34e+07
Relative error: 6.14e-01
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Etheta_1_imag]
Benchmark: [lev=0,Etheta_1_imag] 3.680287420020133e+10
Plotfile : [lev=0,Etheta_1_imag] 4.256520317992176e+10
Absolute error: 5.76e+09
Relative error: 1.57e-01
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Etheta_1_real]
Benchmark: [lev=0,Etheta_1_real] 4.732883545207997e+13
Plotfile : [lev=0,Etheta_1_real] 4.733835048523914e+13
Absolute error: 9.52e+09
Relative error: 2.01e-04
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Ex]
Benchmark: [lev=0,Ex] 2.785316586435500e+11
Plotfile : [lev=0,Ex] 3.155613620198701e+11
Absolute error: 3.70e+10
Relative error: 1.33e-01
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Ey]
Benchmark: [lev=0,Ey] 4.732887622748112e+13
Plotfile : [lev=0,Ey] 4.733842449081089e+13
Absolute error: 9.55e+09
Relative error: 2.02e-04
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Ez]
Benchmark: [lev=0,Ez] 5.140066643749789e+11
Plotfile : [lev=0,Ez] 4.954362114743168e+11
Absolute error: 1.86e+10
Relative error: 3.61e-02
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Ez_0_real]
Benchmark: [lev=0,Ez_0_real] 4.990080753347451e+11
Plotfile : [lev=0,Ez_0_real] 4.942119661171335e+11
Absolute error: 4.80e+09
Relative error: 9.61e-03
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Ez_1_imag]
Benchmark: [lev=0,Ez_1_imag] 1.565161989236617e+12
Plotfile : [lev=0,Ez_1_imag] 1.570134608846283e+12
Absolute error: 4.97e+09
Relative error: 3.18e-03
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Ez_1_real]
Benchmark: [lev=0,Ez_1_real] 2.889892227275169e+10
Plotfile : [lev=0,Ez_1_real] 4.249195106750840e+10
Absolute error: 1.36e+10
Relative error: 4.70e-01
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Jr_0_real]
Benchmark: [lev=0,Jr_0_real] 1.459118139844954e+12
Plotfile : [lev=0,Jr_0_real] 1.230904961041057e+12
Absolute error: 2.28e+11
Relative error: 1.56e-01
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Jr_1_imag]
Benchmark: [lev=0,Jr_1_imag] 2.335663058920072e+17
Plotfile : [lev=0,Jr_1_imag] 2.335662614521673e+17
Absolute error: 4.44e+10
Relative error: 1.90e-07
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Jr_1_real]
Benchmark: [lev=0,Jr_1_real] 2.726204346551292e+12
Plotfile : [lev=0,Jr_1_real] 1.581334229820992e+12
Absolute error: 1.14e+12
Relative error: 4.20e-01
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Jtheta_0_real]
Benchmark: [lev=0,Jtheta_0_real] 4.993840299702145e+11
Plotfile : [lev=0,Jtheta_0_real] 7.622167130668668e+11
Absolute error: 2.63e+11
Relative error: 5.26e-01
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Jtheta_1_imag]
Benchmark: [lev=0,Jtheta_1_imag] 1.179215927404283e+12
Plotfile : [lev=0,Jtheta_1_imag] 1.358155350294726e+12
Absolute error: 1.79e+11
Relative error: 1.52e-01
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Jtheta_1_real]
Benchmark: [lev=0,Jtheta_1_real] 2.176637158800680e+17
Plotfile : [lev=0,Jtheta_1_real] 2.176634098911544e+17
Absolute error: 3.06e+11
Relative error: 1.41e-06
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Jz_0_real]
Benchmark: [lev=0,Jz_0_real] 1.832470462501307e+15
Plotfile : [lev=0,Jz_0_real] 1.962134116344142e+15
Absolute error: 1.30e+14
Relative error: 7.08e-02
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Jz_1_imag]
Benchmark: [lev=0,Jz_1_imag] 6.219241498557210e+14
Plotfile : [lev=0,Jz_1_imag] 7.551991618245542e+14
Absolute error: 1.33e+14
Relative error: 2.14e-01
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Jz_1_real]
Benchmark: [lev=0,Jz_1_real] 6.609096462590301e+14
Plotfile : [lev=0,Jz_1_real] 5.998961639927355e+14
Absolute error: 6.10e+13
Relative error: 9.23e-02
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,jx]
Benchmark: [lev=0,jx] 2.109207014985526e+12
Plotfile : [lev=0,jx] 1.848342251054847e+12
Absolute error: 2.61e+11
Relative error: 1.24e-01
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,jy]
Benchmark: [lev=0,jy] 2.176637088471564e+17
Plotfile : [lev=0,jy] 2.176633659793744e+17
Absolute error: 3.43e+11
Relative error: 1.58e-06
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,jz]
Benchmark: [lev=0,jz] 1.954236712029783e+15
Plotfile : [lev=0,jz] 2.115728318144656e+15
Absolute error: 1.61e+14
Relative error: 8.26e-02
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,rho]
Benchmark: [lev=0,rho] 3.948073055606762e+07
Plotfile : [lev=0,rho] 3.999317718855819e+07
Absolute error: 5.12e+05
Relative error: 1.30e-02
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,rho_0_real]
Benchmark: [lev=0,rho_0_real] 3.905592650167212e+07
Plotfile : [lev=0,rho_0_real] 3.948834470944907e+07
Absolute error: 4.32e+05
Relative error: 1.11e-02
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,rho_1_imag]
Benchmark: [lev=0,rho_1_imag] 2.166077034248945e+07
Plotfile : [lev=0,rho_1_imag] 2.197620601856582e+07
Absolute error: 3.15e+05
Relative error: 1.46e-02
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,rho_1_real]
Benchmark: [lev=0,rho_1_real] 2.131498060778751e+06
Plotfile : [lev=0,rho_1_real] 1.688270374076852e+06
Absolute error: 4.43e+05
Relative error: 2.08e-01

   WARNING: unable to copy analysis image
   archiving the output...
   creating problem test report ...
   LaserAccelerationRZ FAILED
PhilMiller commented 2 years ago 
configuring LaserIonAcc2d build...
   mkdir /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-WL26tpAmPi/warpx/builddir
   cmake  -DAMReX_ASSERTIONS=ON -DAMReX_TESTING=ON -DWarpX_DIMS=2 -DWarpX_OPENPMD=ON -S /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-WL26tpAmPi/warpx/ -B /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-WL26tpAmPi/warpx/builddir 

building LaserIonAcc2d...
   cmake --build /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-WL26tpAmPi/warpx/builddir -j 8 --  
   Compilation time: 11.766 s
   run & test directory: /private/var/folders/dp/8d6ytsgx01d2dwck1fccc9c40000gn/T/ci-WL26tpAmPi/rt-WarpX/WarpX-tests/2022-03-17/LaserIonAcc2d/
   copying files to run directory...
   path to input file: Examples/Physics_applications/laser_ion/inputs
   running the test...
   mpiexec -n 2 ./LaserIonAcc2d.ex inputs  diag1.file_prefix=LaserIonAcc2d_plt   amrex.abort_on_unused_inputs=1 amrex.fpe_trap_invalid=1 amrex.fpe_trap_zero=1 amrex.fpe_trap_overflow=1 warpx.always_warn_immediately=1 warpx.abort_on_warning_threshold=low warpx.do_dynamic_scheduling=0 warpx.serialize_initial_conditions=1 amr.n_cell=384 512 max_step=100
   Execution time: 14.032 s
   WARNING: unable to open the job_info file
   doing the analysis...
   WARNING: analysis failed...
./analysis_default_regression.py  LaserIonAcc2d_plt000100
ERROR: Benchmark and plotfile checksum have different value for key [electrons,particle_id]
Benchmark: [electrons,particle_id] 2.101654260000000e+09
Plotfile : [electrons,particle_id] 2.119404344000000e+09
Absolute error: 1.78e+07
Relative error: 8.45e-03
ERROR: Benchmark and plotfile checksum have different value for key [electrons,particle_momentum_x]
Benchmark: [electrons,particle_momentum_x] 3.819007601037451e-19
Plotfile : [electrons,particle_momentum_x] 3.574005189287193e-19
Absolute error: 2.45e-20
Relative error: 6.42e-02
ERROR: Benchmark and plotfile checksum have different value for key [electrons,particle_momentum_z]
Benchmark: [electrons,particle_momentum_z] 1.644291919825705e-18
Plotfile : [electrons,particle_momentum_z] 1.634228061947837e-18
Absolute error: 1.01e-20
Relative error: 6.12e-03
ERROR: Benchmark and plotfile checksum have different value for key [electrons,particle_position_x]
Benchmark: [electrons,particle_position_x] 8.132686110435036e-03
Plotfile : [electrons,particle_position_x] 8.061408095294435e-03
Absolute error: 7.13e-05
Relative error: 8.76e-03
ERROR: Benchmark and plotfile checksum have different value for key [electrons,particle_position_y]
Benchmark: [electrons,particle_position_y] 3.052975995172882e-02
Plotfile : [electrons,particle_position_y] 3.064166080614125e-02
Absolute error: 1.12e-04
Relative error: 3.67e-03
ERROR: Benchmark and plotfile checksum have different value for key [electrons,particle_weight]
Benchmark: [electrons,particle_weight] 2.641331189632942e+17
Plotfile : [electrons,particle_weight] 2.656377809585464e+17
Absolute error: 1.50e+15
Relative error: 5.70e-03
ERROR: Benchmark and plotfile checksum have different value for key [hydrogen,particle_id]
Benchmark: [hydrogen,particle_id] 8.663540542000000e+09
Plotfile : [hydrogen,particle_id] 8.765678207000000e+09
Absolute error: 1.02e+08
Relative error: 1.18e-02
ERROR: Benchmark and plotfile checksum have different value for key [hydrogen,particle_momentum_x]
Benchmark: [hydrogen,particle_momentum_x] 2.244293053419129e-18
Plotfile : [hydrogen,particle_momentum_x] 2.236355395956550e-18
Absolute error: 7.94e-21
Relative error: 3.54e-03
ERROR: Benchmark and plotfile checksum have different value for key [hydrogen,particle_momentum_z]
Benchmark: [hydrogen,particle_momentum_z] 1.084110863159823e-18
Plotfile : [hydrogen,particle_momentum_z] 1.083990145012640e-18
Absolute error: 1.21e-22
Relative error: 1.11e-04
ERROR: Benchmark and plotfile checksum have different value for key [hydrogen,particle_orig_x]
Benchmark: [hydrogen,particle_orig_x] 8.258544921875001e-03
Plotfile : [hydrogen,particle_orig_x] 8.408564453125000e-03
Absolute error: 1.50e-04
Relative error: 1.82e-02
ERROR: Benchmark and plotfile checksum have different value for key [hydrogen,particle_orig_z]
Benchmark: [hydrogen,particle_orig_z] 3.668963378906250e-02
Plotfile : [hydrogen,particle_orig_z] 3.765047363281250e-02
Absolute error: 9.61e-04
Relative error: 2.62e-02
ERROR: Benchmark and plotfile checksum have different value for key [hydrogen,particle_position_x]
Benchmark: [hydrogen,particle_position_x] 8.258183385255663e-03
Plotfile : [hydrogen,particle_position_x] 8.408180750867633e-03
Absolute error: 1.50e-04
Relative error: 1.82e-02
ERROR: Benchmark and plotfile checksum have different value for key [hydrogen,particle_position_y]
Benchmark: [hydrogen,particle_position_y] 3.668783554837751e-02
Plotfile : [hydrogen,particle_position_y] 3.764868621835830e-02
Absolute error: 9.61e-04
Relative error: 2.62e-02
ERROR: Benchmark and plotfile checksum have different value for key [hydrogen,particle_weight]
Benchmark: [hydrogen,particle_weight] 2.701906737218416e+17
Plotfile : [hydrogen,particle_weight] 2.640644185440041e+17
Absolute error: 6.13e+15
Relative error: 2.27e-02
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,By]
Benchmark: [lev=0,By] 1.139353573084639e+07
Plotfile : [lev=0,By] 1.140066607583954e+07
Absolute error: 7.13e+03
Relative error: 6.26e-04
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Ex]
Benchmark: [lev=0,Ex] 2.033400430027298e+15
Plotfile : [lev=0,Ex] 2.031414277924028e+15
Absolute error: 1.99e+12
Relative error: 9.77e-04
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,Ez]
Benchmark: [lev=0,Ez] 3.160472619678588e+14
Plotfile : [lev=0,Ez] 3.160110992899984e+14
Absolute error: 3.62e+10
Relative error: 1.14e-04
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,jx]
Benchmark: [lev=0,jx] 1.634670809321200e+19
Plotfile : [lev=0,jx] 1.646536819169894e+19
Absolute error: 1.19e+17
Relative error: 7.26e-03
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,jz]
Benchmark: [lev=0,jz] 8.884557829033169e+18
Plotfile : [lev=0,jz] 9.029236106409483e+18
Absolute error: 1.45e+17
Relative error: 1.63e-02
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,rho]
Benchmark: [lev=0,rho] 6.172975446905863e+10
Plotfile : [lev=0,rho] 6.079583063886102e+10
Absolute error: 9.34e+08
Relative error: 1.51e-02
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,rho_electrons]
Benchmark: [lev=0,rho_electrons] 1.745198825491261e+13
Plotfile : [lev=0,rho_electrons] 1.745063803237243e+13
Absolute error: 1.35e+09
Relative error: 7.74e-05
ERROR: Benchmark and plotfile checksum have different value for key [lev=0,rho_hydrogen]
Benchmark: [lev=0,rho_hydrogen] 1.744182000704436e+13
Plotfile : [lev=0,rho_hydrogen] 1.744180880641434e+13
Absolute error: 1.12e+07
Relative error: 6.42e-07

   WARNING: unable to copy analysis image
   archiving the output...
   creating problem test report ...
   LaserIonAcc2d FAILED
PhilMiller commented 2 years ago

More failures once I left this to run:

   PlasmaAccelerationBoost2d FAILED
   PlasmaAccelerationBoost3d FAILED
   PlasmaAccelerationMR FAILED
   PlasmaMirror FAILED
   Python_LaserAcceleration FAILED
   Python_LaserAccelerationMR FAILED
   Python_LaserAccelerationRZ FAILED
   Python_background_mcc FAILED
   Python_background_mcc_1d FAILED
   Python_gaussian_beam FAILED
   Python_prev_positions FAILED
   RefinedInjection FAILED
   RigidInjection_lab FAILED
   Uniform_2d FAILED
   averaged_galilean_2d_psatd FAILED
   averaged_galilean_2d_psatd_hybrid FAILED
   averaged_galilean_3d_psatd FAILED
   averaged_galilean_3d_psatd_hybrid FAILED
   comoving_2d_psatd_hybrid FAILED
   divb_cleaning_3d FAILED
PhilMiller commented 2 years ago

More failures:

galilean_2d_psatd
galilean_2d_psatd_current_correction
galilean_2d_psatd_hybrid
galilean_3d_psatd
galilean_3d_psatd_current_correction
PhilMiller commented 2 years ago

More failures

initial_distribution
ion_stopping
ionization_boost
ionization_lab
momentum-conserving-gather
multi_J_2d_psatd
multi_J_2d_psatd_pml
PhilMiller commented 2 years ago

And just to be clear, there are numerous tests passing in between all of this. I may be excluding unmentioned tests, though, due to missing libraries

PhilMiller commented 2 years ago

OK, here's a fairly complete, consolidated list of the tests that fail as a result of sorting particles at every step:

Langmuir_multi_2d_MR_anisotropic
LaserAccelerationBoost
LaserAccelerationMR
LaserAccelerationRZ
LaserIonAcc2d
PlasmaAccelerationBoost2d
PlasmaAccelerationBoost3d
PlasmaAccelerationMR
PlasmaMirror
Python_LaserAcceleration
Python_LaserAccelerationMR
Python_LaserAccelerationRZ
Python_background_mcc
Python_background_mcc_1d
Python_gaussian_beam
Python_prev_positions
RefinedInjection
RigidInjection_lab
Uniform_2d
averaged_galilean_2d_psatd
averaged_galilean_2d_psatd_hybrid
averaged_galilean_3d_psatd
averaged_galilean_3d_psatd_hybrid
background_mcc
comoving_2d_psatd_hybrid
divb_cleaning_3d
galilean_2d_psatd
galilean_2d_psatd_current_correction
galilean_2d_psatd_hybrid
galilean_3d_psatd
galilean_3d_psatd_current_correction
initial_distribution
ion_stopping
ionization_boost
ionization_lab
momentum-conserving-gather
multi_J_2d_psatd
multi_J_2d_psatd_pml
particle_fields_diags
particle_fields_diags_single_precision
qed_quantum_sync_2d
qed_quantum_sync_3d
qed_schwinger4
reduced_diags
reduced_diags_single_precision
relativistic_space_charge_initialization
restart
space_charge_initialization
space_charge_initialization_2d
uniform_plasma_restart
subcyclingMR
restart_psatd
restart_psatd_time_avg

As a sampling of the impact, here's the worst of the reported relative errors, everything over 10%:

$ grep -h 'Relative error' test_log* | grep -v 'e-0[23456789]$'
Relative error: 2.02e-01
Relative error: 1.65e-01
Relative error: 2.03e-01
Relative error: 9.21e-01
Relative error: 2.57e-01
Relative error: 3.74e+00
Relative error: 2.58e+00
Relative error: 3.74e+00
Relative error: 2.58e+00
Relative error: 1.65e-01
Relative error: 1.22e-01
Relative error: 1.42e-01
Relative error: 9.75e-01
Relative error: 9.75e-01
Relative error: 9.75e-01
Relative error: 9.75e-01
Relative error: 1.91e-01
Relative error: 1.10e-01
Relative error: 1.57e-01
Relative error: 1.56e-01
Relative error: 1.59e-01
Relative error: 2.73e-01
Relative error: 4.55e-01
Relative error: 1.01e-01
Relative error: 1.82e-01
Relative error: 1.76e-01
Relative error: 1.18e-01
Relative error: 2.15e-01
Relative error: 2.21e-01
Relative error: 8.26e-01
Relative error: 3.48e-01
Relative error: 4.60e-01
Relative error: 1.32e-01
Relative error: 1.38e-01
Relative error: 6.14e-01
Relative error: 1.57e-01
Relative error: 1.33e-01
Relative error: 4.70e-01
Relative error: 1.56e-01
Relative error: 4.20e-01
Relative error: 5.26e-01
Relative error: 1.52e-01
Relative error: 2.14e-01
Relative error: 1.24e-01
Relative error: 2.08e-01
Relative error: 2.47e-01
Relative error: 1.19e-01
Relative error: 1.04e-01
Relative error: 2.71e-01
Relative error: 2.35e-01
Relative error: 2.15e-01
Relative error: 2.60e-01
Relative error: 2.52e-01
Relative error: 3.13e-01
Relative error: 6.83e-01
Relative error: 1.20e-01
Relative error: 1.12e-01
Relative error: 1.04e-01
Relative error: 1.31e-01
Relative error: 1.01e-01
Relative error: 1.42e-01
Relative error: 1.85e-01
Relative error: 1.87e-01
Relative error: 1.30e-01
Relative error: 3.29e-01
Relative error: 1.28e-01
Relative error: 1.29e-01
Relative error: 4.25e-01
Relative error: 2.45e-01
Relative error: 1.94e-01
Relative error: 1.10e-01
Relative error: 1.73e-01
Relative error: 1.80e-01
Relative error: 1.59e-01
Relative error: 2.68e-01
Relative error: 4.41e-01
Relative error in Ex: 0.163
Relative error in Ex: 0.146
Relative error in Ey: 0.136
Relative error in Ez: 0.148
Relative error in Ex: 0.076
Relative error in Ey: 0.068
Relative error: 1.71e-01
Relative error: 5.20e-01
PhilMiller commented 2 years ago

@Yin-YinjianZhao since i think you were working on CPU vs GPU physics testing, and the sorting defaults on every 4 steps for GPU