precision-sustainable-ag / Field-Image-Repository-Upload-Monitoring

MIT License
0 stars 0 forks source link

Resolve issues preventing upload of some old images #1

Open danielginn opened 1 year ago

danielginn commented 1 year ago

Earlier versions of the tablet upload app allowed for a few bad upload habits to form.

One was that packaging the images with metadata was sometimes left until a month after the images were taken. This would cause issues such as the same image being packaged twice (and the associated symptom that some images selected were out of sequence). This then caused an issue when trying to upload the RAW images using the raw image upload webpage, which would not upload the raw image because it did not know to what plant package it should be assigned since there was 2 links for it.

A second issue was that the online raw image upload website could be closed during uploading. This caused there to be an image URL link, but no associated raw image (which could not be corrected later and will require deleting the unused image URL).

A third issue was that some image uploads do not contain exactly 10 jpegs.

In addition to these issues, there are a range of inexplicable errors that suggest that the issues need to be resolved by checking everything was uploaded right, rather than trying to think and test for every way things could go wrong.

todo:

zackgrzywacz commented 1 year ago

I have gone through and looked at which .ARW files are missing for Maryland, and it's a lot. Over 1000. These have all been attempted to be uploaded via the weeds-ir uploader, but most of the time they gave a failure message. I have all of these files stored locally so I can attempt to upload them again, but I believe I will continue to get the error message. I have a list of all failed files. Sometimes it's large stretches of failed uploads (like 100s in a row). Other times it's sporadic, sets of 1-2 images in a row that failed to upload.

Note: some of the files listed in this .csv may not have an associated .JPG file. In large sections of missing files (say MDA01000-MDA01300) I included every filename in this range, even if some .JPG files were not uploaded.

failedfiles.csv