Hi-PACE / hipace

Highly efficient Plasma Accelerator Emulation, quasistatic particle-in-cell code
https://hipace.readthedocs.io
Other
51 stars 14 forks source link

Add fix for slow GPU aware MPI to JSC booster script #1133

Closed AlexanderSinn closed 1 month ago

AlexanderSinn commented 2 months ago

In my testing so far, setting this environment variable greatly improves performance of GPU-aware MPI on the booster. 

export UCX_CUDA_COPY_REG_WHOLE_ALLOC=on
MaxThevenet commented 1 month ago

Did you exchange with JSC on this? Any chance this could be useful feedback to them?

AlexanderSinn commented 1 month ago

Yes I talked to JSC support a lot about this. However, we agreed that the setting might not improve performance (and could worsen it) for most other codes.