@manishacaleb had a run where some input catalogues were malformed and failed during reading. The pipeline failed with an error, we identified the problem, fixed the inputs, and executed the run again. This second run attempt also failed, but this time it was because the pipeline tried to read the non-existent measurements.parquet file for the catalogue that caused the first error.
Image objects saved to the database should be deleted if the catalogue read fails.
@manishacaleb had a run where some input catalogues were malformed and failed during reading. The pipeline failed with an error, we identified the problem, fixed the inputs, and executed the run again. This second run attempt also failed, but this time it was because the pipeline tried to read the non-existent
measurements.parquet
file for the catalogue that caused the first error.Image
objects saved to the database should be deleted if the catalogue read fails.