search

radicamc / exoTEDRF

Tools for end-to-end reduction of JWST exoplanet observations
BSD 3-Clause "New" or "Revised" License
0 stars 1 forks source link

Decrease memory requirements where possible #15

Closed radicamc closed 3 weeks ago

radicamc commented 3 months ago

As suggested in #14, try to reduce the memory requirements wherever possible such that the pipeline can, in theory, be run on a laptop computer. There are instances, for example, of a step running, but the plotting routines crashing due to memory requirements. Things like this can be streamlined.

radicamc commented 3 weeks ago

dev branch has a number of memory requirement improvements, particularly in plotting routines. The NIRISS tutorial notebook will now run to completion on my 16Gb Mac laptop. The max memory requirement is ~50Gb, so with a decent amount of available swap, this should run on most laptops. I will continue to make intermittent progress on this.