guillochon / MOSFiT

Modular Open Source Fitter for Transients
http://mosfit.readthedocs.io/
MIT License
41 stars 53 forks source link

mosfit killed by OOM when doing final output and writes nothing to disk #227

Open himisawww opened 1 year ago

himisawww commented 1 year ago

2023-08-24 074728

I guess it is trying to allocate massive memory (O(iterations*walkers)?) when doing output.

This should be avoided.

Also, it says 'All walkers written' but nothing is on disk. (files are all 0 bytes!)

mnicholl commented 1 year ago

There are two things you can do to try to avoid this:

  1. Use the -M flag (see docs)
  2. Use the dynesty sampler, rather than emcee (provides well sampled posteriors without the need to store the chain)