Open RemiLehe opened 4 years ago
Thanks @RemiLehe for reporting this, I will try to investigate soon.
Note: I also tried to simulate the same case with FBPIC, using the Galilean frame (and 3 azimuthal modes) and did not see an instability:
(The modulation of the field along z is due to the fact that the laser driver focuses and defocuses alternatively in the plasma channel, which leads to this pattern in the boosted frame.)
Here is the script: fbpic_script.py.txt
Hi @RemiLehe , Could you please share the bash scripts on Summit? So I can reproduce the issue with the same parallelization (I learned with my last one that that could play a role sometimes - although probably not in this one). Thanks
Of course! Here is the submission script that I used: submission_script.txt (The 2D and 3D simulations were submitted in the same way: both on 1 node, i.e. 6 GPUs)
Thanks!!
Hi again, Sorry that I took a while, but I finally got to compare the 2D and 3D runs with the inputs @RemiLehe shared in this issue. I got the same results:
3D run:
2D run:
The time step is the same so both plots should correspond to the same time. Also it seems that in 3D this instability started after:
At which point both runs seem to agree:
Cheers, Diana
The problem seems to be due to transverse boundary conditions. Replacing
geometry.is_periodic = 0 0 0
with
geometry.is_periodic = 1 1 0
in the 3D input file above seems to remove the instability, see image below. There could be a joke in the PSATD, e.g., some guard cells would have to be reset to 0 at every iteration.
Thanks for finding the issue @MaxThevenet and @jlvay !
Small update:
Testing the input that Rémi shared initially but with geometry.is_periodic = 1 1 0
indeed showed correct fields and particle distribution.
I have an LWFA case in the boosted frame, with the PSATD Galilean scheme, which seems to be unstable in 3D but stable in 2D. There is probably a bug, so I am attaching some info about this:
Here are the reproducing scripts: inputs3d.txt inputs2d.txt This was run on 6 GPUs (one Summit node) in both cases (it is of course quite overkill for 2D).
Here are images of the wakefield at timestep 800 in 3D (unstable) and 2D (stable) respectively: