search

COSIMA / access-om3

ACCESS-OM3 global ocean-sea ice-wave coupled model
13 stars 6 forks source link

Pre-compute mappings? #70

Open aekiss opened 1 year ago

aekiss commented 1 year ago

For performance we might want to pre-compute mappings rather than auto-generating them at runtime (see https://github.com/COSIMA/MOM6-CICE6/pull/5) - but only if auto-generating consumes a lot of walltime.

Unclear whether this is currently possible with CDEPS; might require code changes.

anton-seaice commented 7 months ago

I think we should investigate this before we start doing long runs / cmip7 runs. If they are only getting calculated once after a restart and then stored for the rest of the run that might be ok, but if they are recalculated for every interpolation / regrid then we should definately pre-compute them.

micaeljtoliveira commented 7 months ago

Another important detail is the parallelisation of the mappings computation. Is it serial code? Parallel? If parallel, what is the scalability?

aekiss commented 7 months ago

Online remapping weight generation is parallel, according to slide 5 of @mvertens CW2023 talk.

mvertens commented 7 months ago

@micaeljtoliveira - that is correct. Its totally parallel.

mvertens commented 7 months ago

@micaeljtoliveira - all IO in CMEPS is parallel as well.

aekiss commented 5 months ago

@micaeljtoliveira do your scaling tools allow checking how well the weight generation parallelises?

micaeljtoliveira commented 5 months ago

do your scaling tools allow checking how well the weight generation parallelises?

Yes, we might just need to add some profiling regions.