search

mmbell / samurai

Spline Analysis at Mesoscale Utilizing Radar and Aircraft Instrumentation
GNU General Public License v3.0
12 stars 15 forks source link

Point Haiying to I/O portion of code #63

Open cenamiller opened 2 weeks ago

cenamiller commented 2 weeks ago

Issue when running for multiple users on Jetstream2

cenamiller commented 2 weeks ago

https://github.com/mmbell/samurai/blob/main/README.markdown

John will also send some more details from past emails. I/O is especially slow in cloud, but overall slow everywhere. John suggests augmenting existing GPTL for additional profiling. (Profiling is pretty out of date).

Haiying needs to know where in code to look

johnmauff commented 2 weeks ago

Sent a message to Haiying regarding the build and running Samurai. Also forwarded email thread regarding likely location of code slowdown.

cenamiller commented 1 week ago

Taking this out of 'in progress' until Haiying and Michael have more cycles

cenamiller commented 6 days ago

Jennifer will add link to spreadsheet and code references she shared with Haiying

jcdehart commented 6 days ago

We believe the functions that need to be looked at are the following:

loadMetObs(): VarDriver3D.cpp line 2837 preProcessMetObs(): VarDriver3D.cpp line 428 read_cfrad(): VarDriver.cpp line 2432

read_cfrad is the function that actually reads in the CfRadial radar data and uses some of the LROSE Radx functionality.

For reference, Radx libraries can be found here and here. The RadxVol.hh, RadxRay.hh, RadxSweep.hh, and RadxField.hh describe how the Radx objects are set up.

I shared a google drive folder with the team that includes the spreadsheet describing and comparing all our tests on various computers. There are also some screenshots of top and htop output from some of the tests on the iMac and supercomputer.

Please let us know if you need any other information.

Jen