askap-vast / vast-pipeline

This repository holds the code of the Radio Transient detection pipeline for the VAST project.
https://vast-survey.org/vast-pipeline/
MIT License
8 stars 3 forks source link

Image objects persist after a catalogue read failure #647

Closed marxide closed 2 years ago

marxide commented 2 years ago

@manishacaleb had a run where some input catalogues were malformed and failed during reading. The pipeline failed with an error, we identified the problem, fixed the inputs, and executed the run again. This second run attempt also failed, but this time it was because the pipeline tried to read the non-existent measurements.parquet file for the catalogue that caused the first error.

Image objects saved to the database should be deleted if the catalogue read fails.