As a maintainer of the BUDA platform, I would like to validate the integrity of the S3 file system.
The BUDA S3 file system should both support BUDA correctly, and be clean of extra material.
The BUDA file system should test:
That only the image groups in the BUDA catalog are under images/ on S3.
That each image group contains a readable, parseable dimensions.json
That each image named in the dimensions.json exists in the image group folder. A test to validate the image integrity by opening it in an Image object is possible, but would be very slow.
As a maintainer of the BUDA platform, I would like to validate the integrity of the S3 file system.
The BUDA S3 file system should both support BUDA correctly, and be clean of extra material.
The BUDA file system should test:
That only the image groups in the BUDA catalog are under
images/on S3.That each image group contains a readable, parseable
dimensions.jsonThat each image named in the
dimensions.jsonexists in the image group folder. A test to validate the image integrity by opening it in an Image object is possible, but would be very slow.