search

geodynamics / aspect

A parallel, extensible finite element code to simulate convection in both 2D and 3D models.
https://aspect.geodynamics.org/
Other
227 stars 237 forks source link

Allow setting LFS stripe count. #6104

Closed bangerth closed 4 weeks ago

bangerth commented 1 month ago

This is an attempt at making the use of LFS stripe counts a bit easier. Fixes #6035.

@lhy11009 Could you take a look here and potentially give this a try?

lhy11009 commented 1 month ago

Fascinating! Thank you for implementing this new feature. Here’s my plan for testing:

I will pull and compile your branch on Frontera, then run the previously problematic case using approximately 4,000 cores with a large checkpoint output file (around 100 GB). I’ll verify that the file striping settings are applied correctly and ensure that the checkpointing is successfully generated.

I’ll keep you updated with the results.

bangerth commented 1 month ago

Not sure what exactly caused these changes -- I think I accidentally called the indent script when I had un-closed double quotes somewhere. Thanks for pointing it out, it's not fixed.

bangerth commented 1 month ago

We have a circularity problem here because I'm introducing a new parameter, reference it in the sphinx documentation (which of course doesn't know anything about it, because it's not in parameters.md yet), and then get the error

file-system-io.md:11: WARNING: undefined label: 'parameters:output_20directory_20lfs_20stripe_20count' [ref.ref]

Should I just run the parameter update script too?

gassmoeller commented 1 month ago

Feel free to run the update script for the parameters. We just merged #6098 so it should not change much except for your new parameter in this PR.

bangerth commented 1 month ago

OK, this worked.

bangerth commented 4 weeks ago

@lhy11009 This is now merged. It would be really nice to get feedback on whether it actually works! Thank you in advance!