Missing images from our.hpc.msstate.edu

[hohonuuli]

From @kevinsbarnard

it looks like a large number (5.6k) of images in FathomNet now have dead links. This is a bit of a problem for FathomVerse as well, but not urgent. These all seem to be URLs under https://oer.hpc.msstate.edu/FathomNet. I'm wondering if these were accidentally wiped as part of the FathomNet-NCEI data hosting?

[hohonuuli]

I'm running the code below to update the validation state. The automated cronjob that notifies image owners that their images are off line was failing (maybe a reset API key). I've rebuilt the docker image with a new key so that should be addressed. I'm manually running the validation and notification code now.

validate-images -s 2022-10-30 -k <some key> -u http://fathomnet.org:8080

[hohonuuli]

The validate is going to run for a while. When it's done I need to run:

invalid-image-notify -u http://fathomnet.org:8080

[hohonuuli]

Output from invalid-image-notify:

Sending email to brian@deepsubmergence.com to notify them of 5700 invalid images

[hohonuuli]

Sent this email to Errol and Yee:

There was data being hosted at https://oer.hpc.msstate.edu/FathomNet that is no longer there. It looks like that data was submitted to FathomNet by Brian Kennedy for a series of Okeanos dives. The reference to the collection is at https://fathomnet.org/fathomnet/#/collection/images/a1236a3e-bad8-46ee-b274-6881e264c953.

Can you restore that “FathomNet” data directory?

[hohonuuli]

From Yee:

Sorry for the broken links! We didn't know anyone was using them. We were trying to clean up the top FathomNet directory to make it less crowded with files. Megan gave us the ok to move all those files into a subdirectory named "BenthicAnimalGuide_training/".

If it's too much trouble for you to add this subdirectory string into your website, then we can move all the files back to the top FathomNet directory. Let us know.

[hohonuuli]

Fixed with

UPDATE images
SET
    url = REPLACE(url, 'https://oer.hpc.msstate.edu/FathomNet/', 'https://oer.hpc.msstate.edu/FathomNet/BenthicAnimalGuide_training/')
WHERE
    url LIKE 'https://oer.hpc.msstate.edu/FathomNet/%';