ptiede / Comrade.jl

MIT License
43 stars 8 forks source link

Allow AHMC to save directly to disk #302

Closed ptiede closed 1 year ago

ptiede commented 1 year ago

The models are getting to be high enough dimension that storing the samples in memory is causing a problem. This adds a simple option to save the samples to disk. The current implementation serializes the usual TypeTable as a JLD2 object. We then provide a load_table function that allows you to load the table or just slices of the table into memory.

codecov[bot] commented 1 year ago

Codecov Report

Patch coverage: 84.61% and project coverage change: +0.77 :tada:

Comparison is base (52c05d5) 81.74% compared to head (734d16a) 82.52%.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #302 +/- ## ========================================== + Coverage 81.74% 82.52% +0.77% ========================================== Files 37 37 Lines 3134 3159 +25 ========================================== + Hits 2562 2607 +45 + Misses 572 552 -20 ``` | [Impacted Files](https://app.codecov.io/gh/ptiede/Comrade.jl/pull/302?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Paul+Tiede) | Coverage Δ | | |---|---|---| | [lib/ComradeAHMC/src/ComradeAHMC.jl](https://app.codecov.io/gh/ptiede/Comrade.jl/pull/302?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Paul+Tiede#diff-bGliL0NvbXJhZGVBSE1DL3NyYy9Db21yYWRlQUhNQy5qbA==) | `90.32% <84.61%> (+32.96%)` | :arrow_up: |

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.