jrbourbeau / pyunfold

Iterative unfolding for Python
https://jrbourbeau.github.io/pyunfold/
MIT License
26 stars 13 forks source link

Manage memory #110

Open jvavrek opened 4 years ago

jvavrek commented 4 years ago

This PR allows one to set the dtype and max memory allowed for the CovarianceMatrix---handy when response matrices start getting large.

I branched off of my other PR branch sparse_poisson by mistake, but if there's interest in merging this without that branch, it can be redone.

Tests pass on my machine with dtype=np.float64, but not with dtype=np.float32---small precision differences apparently fall outside the rtol of some of the comparisons.

As before, CI tests here fail due to timeouts