search

c3-time-domain / SeeChange

A time-domain data reduction pipeline (e.g., for handling images->lightcurves) for surveys like DECam and LS4
BSD 3-Clause "New" or "Revised" License
0 stars 4 forks source link

Verify memory isn't wasted on an exposure in pipline_exposure_launcher.py #333

Open rknop opened 2 months ago

rknop commented 2 months ago

See comment in ExposureProcessor.download_and_load_exposure in pipeline/pipeline_exposure_processor.py:

        # TODO : this Exposure object is going to be copied into every processor subprocess                             
        #   *Ideally* no data was loaded, only headers, so the amount of memory used is                                 
        #   not significant, but we should investigate/verify this, and deal with it if                                 
        #   that is not the case.