search

E3SM-Project / scorpio

A high-level Parallel I/O Library for structured grid applications
19 stars 16 forks source link

FYI: Frontier Lustre filesystem: No need for manual striping #509

Closed sarats closed 1 year ago

sarats commented 1 year ago

FYI from https://docs.olcf.ornl.gov/systems/frontier_user_guide.html#transition-from-alpine-to-orion

Frontier mounts Orion, a parallel filesystem based on Lustre and HPE ClusterStor, with a 679 PB
usable namespace (/lustre/orion/). Orion uses a feature called Progressive File Layout (PFL) that
changes the striping of files as they grow. Because of this, we ask users not to manually adjust
the file striping. If you feel the default striping behavior of Orion is not meeting your needs,
please contact [help@olcf.ornl.gov](mailto:help%40olcf.ornl.gov).

Can you confirm that Scorpio doesn't try to set some striping by default?

dqwu commented 1 year ago

@sarats We do not set the file striping for Frontier right now. We will leave it as it is and will contact the help desk if the performance is not what we expect.