GEOS-ESM / GEOSldas_GridComp

Apache License 2.0
1 stars 0 forks source link

more optimal distribution of tiles in cubed-sphere grid tile space #41

Closed weiyuan-jiang closed 5 months ago

weiyuan-jiang commented 5 months ago

PR addresses a situation where too many processors are requested for a cube-sphere tile space simulation. In this case, a process may end up with a domain that consists of a stripe that is only one grid cell wide, which causes the re-gridder to fail. The PR ensures that each process has a stripe that is at least 2 grid cells wide.

The PR further improves the distribution of tiles onto processors.

IMPORTANT: The PR is not zero-diff for data assimilation in cube-sphere tile space. This is because the GLOBALCS/assim test case has never been zero-diff when the layout changed.

Tests are also non-zero-diff for the AGGGLOBALCS/model case, but 0-diff is not required/expected with layout changes when using "aggressive" compilation.

biljanaorescanin commented 5 months ago

Nightly Tests summary: globalcs assim comparison failed. aggglobalcs both model and assim run comparison failed. gnuglobalcs assim comparison failed.

These are in slurm conus.model.slurm:ntasks_model: 40 global.assim.slurm:ntasks_model: 120 globalcnclm45.model.slurm:ntasks_model: 120 globalcnclm4.model.slurm:ntasks_model: 120 globalcs.assim.slurm:ntasks_model: 120 globalcscn.model.slurm:ntasks_model: 120 globalcs.model.slurm:ntasks_model: 120 global.model.slurm:ntasks_model: 80

and ntasks-per-node is 40