jhpoelen
commented
1 year ago after re-tracking the previously missed image urls, the following tracking log was generated:
Open jhpoelen opened 1 year ago
jhpoelen
commented
1 year ago after re-tracking the previously missed image urls, the following tracking log was generated:
jhpoelen
commented
1 year ago It appears that the following 33 images are still missing after a retry:
https://bisque.cyverse.org/image_service/image/00-7J9FqXFGUzAyrVZbgJJoGG/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-anTuWfwkPTuFCGbS4QVpgT/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-bd6zjsQ5MUErQZS9M5Sr8M/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-bedLvssypaWBZSXxH7xkkc/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-bP7yMwFuoJqkHLXgVxpbm8/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-dDfCUqfDWiKywrvcXaEkWY/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-dguyqrpa3MhC4mFQAvffiE/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-drdU6yfV2iMHEScNCCnauC/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-fzaczeURipNgfB5ATsN9jX/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-gdGPD7Xmo9NoqSDKXszgN/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-iX4e3CcK6qDU4npjabyE39/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-jt29JHUMYHVZBdMwX8YEjf/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-JTMsT2xqjGtEkrJ2XTUnf8/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-K6MzoZ5CzDCjkYNrToQVCT/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-KFQVR865F2tCnmFuFE2Sfc/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-Kknpm4havinGzqosXCiy84/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-kTVY9mVbNbMmJ9m6sEa6ei/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-MAGixLashpnnatT3B9DDLb/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-mDAzNumFjZw6UcTadscLNf/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-N4VHTti4mToXwCcJXHHQnB/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-NNbUnwSApdKpwV88jya73Q/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-NseahtVLc4aigczTwhpx38/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-Q8wQTFuJfBGKFXHQRjfSca/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-rB3x6s6GiQDf3zM39XWbte/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-Va4gmxvFrMyhNGahaDBrze/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-Vg77D6CrcTp2M3bM5q2WbP/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-wmVFuTzpyNtMqiGZrbp2GZ/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-wQhG7Kwjx7bfixi3xgnDxG/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-Y4gyWqVBAWTjQxvijXmXxC/resize:1250/format:jpeg
https://bisque.cyverse.org/image_service/image/00-zEx63i64ZvuGotD3whiFfT/resize:1250/format:jpeg
https://portal.torcherbaria.org/imglib/seinet/torch/BRIT/202006/field_madder-6270273_1593287703.jpg
https://portal.torcherbaria.org/imglib/seinet/torch/BRIT/202007/scf_35-2_1595371669.jpg
https://portal.torcherbaria.org/imglib/seinet/torch/BRIT/202010/IMG_0846_1601579155.jpgso it appears that 156 - 33 = 123 images were only temporarily unavailable.
jhpoelen
commented
1 year ago note that for these 33 images, running curl produced the following results:
$ cat missing.txt | xargs -L1 curl -I
HTTP/1.1 415 Unsupported Media Type
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:25:38 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 400 Bad Request
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:25:39 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 400 Bad Request
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:25:39 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 415 Unsupported Media Type
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:25:41 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 400 Bad Request
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:25:41 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 415 Unsupported Media Type
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:25:42 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 415 Unsupported Media Type
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:25:44 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 415 Unsupported Media Type
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:25:45 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 415 Unsupported Media Type
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:25:47 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 415 Unsupported Media Type
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:25:48 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 415 Unsupported Media Type
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:25:49 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 415 Unsupported Media Type
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:25:51 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 415 Unsupported Media Type
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:25:52 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 415 Unsupported Media Type
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:25:54 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 400 Bad Request
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:25:54 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 400 Bad Request
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:25:55 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 415 Unsupported Media Type
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:25:56 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 415 Unsupported Media Type
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:26:01 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 415 Unsupported Media Type
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:26:02 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 415 Unsupported Media Type
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:26:04 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 400 Bad Request
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:26:04 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 400 Bad Request
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:26:05 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 400 Bad Request
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:26:05 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 400 Bad Request
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:26:06 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 400 Bad Request
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:26:06 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 400 Bad Request
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:26:07 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 415 Unsupported Media Type
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:26:08 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 400 Bad Request
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:26:09 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 400 Bad Request
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:26:09 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 400 Bad Request
Server: nginx/1.14.0
Date: Tue, 26 Jul 2022 17:26:10 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 0
HTTP/1.1 404 Not Found
Date: Tue, 26 Jul 2022 17:26:10 GMT
Server: Apache/2.4.6 (CentOS) OpenSSL/1.0.2k-fips PHP/7.3.21
Content-Type: text/html; charset=iso-8859-1
HTTP/1.1 404 Not Found
Date: Tue, 26 Jul 2022 17:26:10 GMT
Server: Apache/2.4.6 (CentOS) OpenSSL/1.0.2k-fips PHP/7.3.21
Content-Type: text/html; charset=iso-8859-1
HTTP/1.1 404 Not Found
Date: Tue, 26 Jul 2022 17:26:11 GMT
Server: Apache/2.4.6 (CentOS) OpenSSL/1.0.2k-fips PHP/7.3.21
Content-Type: text/html; charset=iso-8859-1
when indexing all of BRIT during June/July 2022 some 156 images failed to resolve -
the image URLs include: