AtlasOfLivingAustralia / image-service

Image repository and tiling services
https://images.ala.org.au
0 stars 17 forks source link

FailedUpload table only saves failed images urls #202

Open vjrj opened 3 months ago

vjrj commented 3 months ago

We ingested a dr with multimedia but the source of images was down. When the publisher recovered their images server, we reinjested the dr but the images processing failed with errors (and no logs).

Enabling the debug logs I noticed that the images where skipped:

We have already attempted to load https://example.com/18673-CG_1.jpg without success. Skipping.

because this check and because the url was logged in the failed upload table.

I removed the logged urls from db and retried the ingestion to correctly process the images.

It seems that this table saves that failed urls but I don't see any mechanism to clean that table from time to time or via the admin interface so that urls will be skipped forever.

If I'm not wrong, it seems to me like a not finished functionality.

Maybe #201 is related.