E3SM-Project / scorpio

A high-level Parallel I/O Library for structured grid applications
Other
21 stars 16 forks source link

No need to define and write attributes on all ranks for ADIOS IO type #535

Closed dqwu closed 1 year ago

dqwu commented 1 year ago

This patch is provided by @tkurc (Tahsin Kurc), which is required for an ultra-high resolution scream IO benchmark test run with 8K nodes on Frontier using ADIOS IO type to pass.

For ADIOS IO type, there is no need to define the same attributes on all ranks, which might greatly increase the attribute metadata size and cause ADIOS lib to throw an exception when trying to gathering more than 2^31 elements.