search

durbank / PAIPR

Functions to generate probabilistic estimates of annual accumulation from ice-penetrating radar without the need for manual layer selection or correction
3 stars 0 forks source link

Memory use could use optimization #47

Closed durbank closed 3 years ago

durbank commented 4 years ago

Right now the processing of results (particularly in parallel) is pretty memory-intensive. It would be good to find ways to reduce the memory load where possible so that on the large-RAM CPUs (96+ GB) we can process more chunks at the same time.

durbank commented 4 years ago

This will likely require restructuring radar_age. I'll want to look into merging the 3rd and 4th dimensions (r_param and likelihood iteration). This may also help alleviate some of the multi-modal issues in the final estimates, as these may result somewhat from the descritized nature of the r_param sampling.

durbank commented 3 years ago

This is addressed in PR #48