In #730 I fixed a memory leak in pipeline.new_sources.new_sources, but the actual implementation was quite hacky.
As commented in the code, the function should be rewritten to reflect the new behaviour of pipeline.new_sources.parallel_get_rms_measurements. The below section should be incorporated into parallel_get_rms_measurements, and parallel_get_rms_measurements should be renamed to something like parallel_get_new_high_sigma.
In #730 I fixed a memory leak in
pipeline.new_sources.new_sources
, but the actual implementation was quite hacky.As commented in the code, the function should be rewritten to reflect the new behaviour of
pipeline.new_sources.parallel_get_rms_measurements
. The below section should be incorporated intoparallel_get_rms_measurements
, andparallel_get_rms_measurements
should be renamed to something likeparallel_get_new_high_sigma
.https://github.com/askap-vast/vast-pipeline/blob/705a815e807eab74e4563274d7a45eab7e3c4396/vast_pipeline/pipeline/new_sources.py#L439-L472