fkirmani / diffimageml

scrum sprint for ML transient detection/classification in difference images
BSD 3-Clause "New" or "Revised" License
2 stars 4 forks source link

record progress through the pipeline in a processing log file #24

Open srodney opened 3 years ago

srodney commented 3 years ago

We want each processing function to write a status update into a simple ascii text file that records progress through the pipeline. This log file should be created when a new fakesnplanter object is instantiated, and updated at each stage of the fake-planting pipeline (build ePSF, plant fakes, detect sources).

Could just be a simple ascii catalog that we read/write using astropy table functions, flipping a 0 to a 1 when a process gets done.

A more sophisticated record could be made, logging info about the processing time, number of fakes planted, etc. — but let's only do that if we find it is really needed.