search

pypeit / PypeIt-development-suite

8 stars 11 forks source link

Increase default storage requested, add --storage argument #329

Closed badpandabear closed 2 months ago

badpandabear commented 2 months ago

Increase the default ephemeral-storage requested in nautilus to 400 GiB, and add a -storage argument so it can be increased without requiring a code change in the future. A 50 GiB buffer is added to "limits" of the nautilus job (the amount which will cause the job to be killed).

badpandabear commented 2 months ago 
Test Summary
--------------------------------------------------------
--- PYTEST PYPEIT UNIT TESTS PASSED  256 passed, 70 warnings in 560.68s (0:09:20) ---
--- PYTEST UNIT TESTS PASSED  148 passed, 167 warnings in 1065.25s (0:17:45) ---
--- PYTEST VET TESTS PASSED  62 passed, 108 warnings in 6040.45s (1:40:40) ---
--- PYPEIT DEVELOPMENT SUITE PASSED 239/239 TESTS  ---
Testing Started at 2024-08-27T00:27:49.355041
Testing Completed at 2024-08-27T20:46:26.151494
Total Time: 20:18:36.796453
upload: ./pypeit.report to s3://pypeit/Reports/dusty-devsuite-storage.report
upload: ./performance.csv to s3://pypeit/Reports/dusty-devsuite-storage_performance.csv

Monitoring the test showed a max disk usage of 367GiB, less than the new defaults.