Split cell transfer into a number of passes in load balance.

fmihpc / vlasiator

Vlasiator - ten letters you can count on

https://www.helsinki.fi/en/researchgroups/vlasiator

Other

47 stars 38 forks source link

Split cell transfer into a number of passes in load balance. #1017

Closed ykempf closed 2 weeks ago

ykempf commented 1 month ago

Allows to avoid memory peaks and is adaptive. Hard-coded to allow up to 10% of a tasks's blocks being sent in one pass.

ykempf commented 1 month ago

Ready to merge if the test on Mahti reports sensible numbers of transfers. @markusbattarbee:

grep num /scratch/project_2005018/202407_FIG_derived_memory_checks/FIG_CopyAndEXB_memreports_determine_chunks_from_blocks_shrink_1.1_cleanedup/slurm-3674502.out

will give the list of the number of chunks it took during that slot once it's run.

ykempf commented 2 weeks ago

I added a parenthesis to this guy as suggested by some CI test, but it doesn't change the functionality so I guess it can go in soon?