search

lovasoa / dezoomify-rs

Zoomable image downloader for Google Arts & Culture, Zoomify, IIIF, and others
https://dezoomify-rs.ophir.dev
GNU General Public License v3.0
739 stars 66 forks source link

NLA #38

Open look2020 opened 4 years ago

look2020 commented 4 years ago

I have a problem downloading the map image on the NLA website, could you kindly help check?

Here is the link: https://nla.gov.au/nla.obj-2646882352/dzi?tile=

dezoomify-rs can list the tiles, but when tried to download, it shrew out WARN messages like:

C:\Users\User>C:\dezoomify-rs\dezoomify-rs.exe Enter an URL or a path to a tiles.yaml file: https://nla.gov.au/nla.obj-2646882352/dzi?tile= Found the following zoom levels:

  1. Deep Zoom Image (20424 x 31978 pixels, 10000 tiles)
  2. Deep Zoom Image (10212 x 15989 pixels, 2520 tiles)
  3. Deep Zoom Image ( 5106 x 7995 pixels, 640 tiles)
  4. Deep Zoom Image ( 2553 x 3998 pixels, 160 tiles)
  5. Deep Zoom Image ( 1277 x 1999 pixels, 40 tiles)
  6. Deep Zoom Image ( 639 x 1000 pixels, 12 tiles)
  7. Deep Zoom Image ( 320 x 500 pixels, 4 tiles)
  8. Deep Zoom Image ( 160 x 250 pixels, 1 tiles)
  9. Deep Zoom Image ( 80 x 125 pixels, 1 tiles)
  10. Deep Zoom Image ( 40 x 63 pixels, 1 tiles)
  11. Deep Zoom Image ( 20 x 32 pixels, 1 tiles)
  12. Deep Zoom Image ( 10 x 16 pixels, 1 tiles)
  13. Deep Zoom Image ( 5 x 8 pixels, 1 tiles)
  14. Deep Zoom Image ( 3 x 4 pixels, 1 tiles)
  15. Deep Zoom Image ( 2 x 2 pixels, 1 tiles)
  16. Deep Zoom Image ( 1 x 1 pixels, 1 tiles) Which level do you want to download? 1 [ETA:0s] ######################################## 0/0 Computing the URLs of the image tiles... [2020-05-06T23:59:09Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/13_0.jpg'. Retrying in 2.56s [2020-05-06T23:59:09Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/7_0.jpg'. Retrying in 3.84s [2020-05-06T23:59:09Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/9_0.jpg'. Retrying in 2.08s [2020-05-06T23:59:09Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/12_0.jpg'. Retrying in 3.44s [2020-05-06T23:59:09Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/1_0.jpg'. Retrying in 3.12s [2020-05-06T23:59:09Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/14_0.jpg'. Retrying in 3.68s [2020-05-06T23:59:09Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/10_0.jpg'. Retrying in 3.2s [2020-05-06T23:59:09Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/15_0.jpg'. Retrying in 2.8s [2020-05-06T23:59:09Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/5_0.jpg'. Retrying in 3.6s [2020-05-06T23:59:09Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/3_0.jpg'. Retrying in 3.36s [2020-05-06T23:59:09Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/0_0.jpg'. Retrying in 2s [2020-05-06T23:59:09Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/4_0.jpg'. Retrying in 2.48s [2020-05-06T23:59:09Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/8_0.jpg'. Retrying in 2.96s [2020-05-06T23:59:09Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/6_0.jpg'. Retrying in 2.72s [2020-05-06T23:59:09Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/11_0.jpg'. Retrying in 2.32s [ETA:1h] #--------------------------------------- 3/2520 error with tile https://nla.gov.au/nla_files/14/9_0.jpg: net[ETA:1h] #--------------------------------------- 4/2520 error with tile https://nla.gov.au/nla_files/14/2_0.jpg: net[ETA:1h] #--------------------------------------- 5/2520 error with tile https://nla.gov.au/nla_files/14/11_0.jpg: network error: HTTP status client error (404 Not Found) for url (https://nla.gov.au/nla_files/14/11_0.jpg) [2020-05-06T23:59:11Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/16_0.jpg'. Retrying in 3.92s [ETA:53m] #--------------------------------------- 7/2520 error with tile https://nla.gov.au/nla_files/14/13_0.jpg: network error: HTTP status client error (404 Not Found) for url (https://nla.gov.au/nla_files/14/13_0.jpg) [2020-05-06T23:59:12Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/18_0.jpg'. Retrying in 2.16s [ETA:46m] #--------------------------------------- 9/2520 error with tile https://nla.gov.au/nla_files/14/15_0.jpg: network error: HTTP status client error (404 Not Found) for url (https://nla.gov.au/nla_files/14/15_0.jpg) [2020-05-06T23:59:12Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/20_0.jpg'. Retrying in 2.4s [ETA:43m] #--------------------------------------- 10/2520 error with tile https://nla.gov.au/nla_files/14/8_0.jpg: ne[ETA:31m] #--------------------------------------- 11/2520 error with tile https://nla.gov.au/nla_files/14/1_0.jpg: ne[ETA:31m] #--------------------------------------- 11/2520 error with tile https://nla.gov.au/nla_files/14/10_0.jpg: network error: HTTP status client error (404 Not Found) for url (https://nla.gov.au/nla_files/14/10_0.jpg) [2020-05-07T00:06:10Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/22_0.jpg'. Retrying in 2.64s [2020-05-07T00:06:10Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/23_0.jpg'. Retrying in 3.76s [2020-05-07T00:06:11Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/25_0.jpg'. Retrying in 2s [2020-05-07T00:06:11Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/24_0.jpg'. Retrying in 2.88s [2020-05-07T00:06:11Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/36_0.jpg'. Retrying in 2.32s [2020-05-07T00:06:11Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/37_0.jpg'. Retrying in 3.44s [2020-05-07T00:06:11Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/29_0.jpg'. Retrying in 2.48s [2020-05-07T00:06:11Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/32_0.jpg'. Retrying in 3.84s [2020-05-07T00:06:11Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/30_0.jpg'. Retrying in 3.6s [2020-05-07T00:06:11Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/26_0.jpg'. Retrying in 3.12s [2020-05-07T00:06:11Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/28_0.jpg'. Retrying in 3.36s [2020-05-07T00:06:11Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/33_0.jpg'. Retrying in 2.96s [2020-05-07T00:06:11Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/31_0.jpg'. Retrying in 2.72s [2020-05-07T00:06:11Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/27_0.jpg'. Retrying in 2.24s [2020-05-07T00:06:11Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/35_0.jpg'. Retrying in 3.2s [ETA:16h] #--------------------------------------- 23/2520 error with tile https://nla.gov.au/nla_files/14/21_0.jpg: n[ETA:15h] #--------------------------------------- 24/2520 error with tile https://nla.gov.au/nla_files/14/22_0.jpg: network error: error sending request for url (https://nla.gov.au/nla_files/14/22_0.jpg): operation timed out [2020-05-07T00:06:13Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/38_0.jpg'. Retrying in 2.56s [ETA:14h] #--------------------------------------- 25/2520 error with tile https://nla.gov.au/nla_files/14/25_0.jpg: n[ETA:13h] #--------------------------------------- 27/2520 error with tile https://nla.gov.au/nla_files/14/36_0.jpg: n[ETA:12h] #--------------------------------------- 28/2520 error with tile https://nla.gov.au/nla_files/14/34_0.jpg: n[ETA:11h] #--------------------------------------- 30/2520 error with tile https://nla.gov.au/nla_files/14/27_0.jpg: network error: HTTP status client error (404 Not Found) for url (https://nla.gov.au/nla_files/14/27_0.jpg) [ETA:11h] #--------------------------------------- 31/2520 error with tile https://nla.gov.au/nla_files/14/24_0.jpg: network error: HTTP status client error (404 Not Found) for url (https://nla.gov.au/nla_files/14/24_0.jpg) [ETA:10h] #--------------------------------------- 32/2520 error with tile https://nla.gov.au/nla_files/14/31_0.jpg: network error: HTTP status client error (404 Not Found) for url (https://nla.gov.au/nla_files/14/31_0.jpg) [2020-05-07T00:06:14Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/3_1.jpg'. Retrying in 2.48s [2020-05-07T00:06:14Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/4_1.jpg'. Retrying in 3.6s [ETA:10h] #--------------------------------------- 33/2520 error with tile https://nla.gov.au/nla_files/14/33_0.jpg: network error: HTTP status client error (404 Not Found) for url (https://nla.gov.au/nla_files/14/33_0.jpg) [ETA:10h] #--------------------------------------- 34/2520 error with tile https://nla.gov.au/nla_files/14/26_0.jpg: network error: HTTP status client error (404 Not Found) for url (https://nla.gov.au/nla_files/14/26_0.jpg) [ETA:9h] #--------------------------------------- 36/2520 error with tile https://nla.gov.au/nla_files/14/28_0.jpg: network error: HTTP status client error (404 Not Found) for url (https://nla.gov.au/nla_files/14/28_0.jpg) [ETA:9h] #--------------------------------------- 37/2520 error with tile https://nla.gov.au/nla_files/14/35_0.jpg: network error: HTTP status client error (404 Not Found) for url (https://nla.gov.au/nla_files/14/35_0.jpg) [ETA:8h] #--------------------------------------- 38/2520 error with tile https://nla.gov.au/nla_files/14/30_0.jpg: network error: HTTP status client error (404 Not Found) for url (https://nla.gov.au/nla_files/14/30_0.jpg) [ETA:8h] #--------------------------------------- 39/2520 error with tile https://nla.gov.au/nla_files/14/32_0.jpg: network error: HTTP status client error (404 Not Found) for url (https://nla.gov.au/nla_files/14/32_0.jpg) [2020-05-07T00:06:15Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/12_1.jpg'. Retrying in 2.56s [2020-05-07T00:06:15Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/11_1.jpg'. Retrying in 3.44s [2020-05-07T00:06:15Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/10_1.jpg'. Retrying in 2.32s [2020-05-07T00:06:16Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/13_1.jpg'. Retrying in 3.68s [ETA:8h] #--------------------------------------- 40/2520 error with tile https://nla.gov.au/nla_files/14/38_0.jpg: ne[ETA:8h] #--------------------------------------- 41/2520 error with tile https://nla.gov.au/nla_files/14/1_1.jpg: net[ETA:7h] #--------------------------------------- 42/2520 error with tile https://nla.gov.au/nla_files/14/3_1.jpg: net[ETA:7h] #--------------------------------------- 44/2520 error with tile https://nla.gov.au/nla_files/14/8_1.jpg: network error: HTTP status client error (404 Not Found) for url (https://nla.gov.au/nla_files/14/8_1.jpg) [ETA:7h] #--------------------------------------- 45/2520 error with tile https://nla.gov.au/nla_files/14/39_0.jpg: network error: HTTP status client error (404 Not Found) for url (https://nla.gov.au/nla_files/14/39_0.jpg) [ETA:7h] #--------------------------------------- 46/2520 error with tile https://nla.gov.au/nla_files/14/0_1.jpg: network error: HTTP status client error (404 Not Found) for url (https://nla.gov.au/nla_files/14/0_1.jpg) [2020-05-07T00:06:18Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/17_1.jpg'. Retrying in 2.16s [ETA:6h] #--------------------------------------- 47/2520 error with tile https://nla.gov.au/nla_files/14/2_1.jpg: net[ETA:6h] #--------------------------------------- 48/2520 error with tile https://nla.gov.au/nla_files/14/7_1.jpg: network error: HTTP status client error (404 Not Found) for url (https://nla.gov.au/nla_files/14/7_1.jpg) [ETA:6h] #--------------------------------------- 50/2520 error with tile https://nla.gov.au/nla_files/14/4_1.jpg: network error: HTTP status client error (404 Not Found) for url (https://nla.gov.au/nla_files/14/4_1.jpg) [2020-05-07T00:06:18Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/21_1.jpg'. Retrying in 2.64s [2020-05-07T00:06:18Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/22_1.jpg'. Retrying in 3.76s [2020-05-07T00:06:18Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/18_1.jpg'. Retrying in 3.28s [2020-05-07T00:06:18Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/23_1.jpg'. Retrying in 2.88s [ETA:6h] #--------------------------------------- 51/2520 error with tile https://nla.gov.au/nla_files/14/12_1.jpg: network error: HTTP status client error (404 Not Found) for url (https://nla.gov.au/nla_files/14/12_1.jpg) [ETA:6h] #--------------------------------------- 53/2520 error with tile https://nla.gov.au/nla_files/14/6_1.jpg: network error: HTTP status client error (404 Not Found) for url (https://nla.gov.au/nla_files/14/6_1.jpg) [2020-05-07T00:06:19Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/26_1.jpg'. Retrying in 2.24s [2020-05-07T00:06:19Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/27_1.jpg'. Retrying in 3.36s [ETA:5h] #--------------------------------------- 55/2520 error with tile https://nla.gov.au/nla_files/14/11_1.jpg: network error: HTTP status client error (404 Not Found) for url (https://nla.gov.au/nla_files/14/11_1.jpg) [ETA:5h] #--------------------------------------- 56/2520 error with tile https://nla.gov.au/nla_files/14/13_1.jpg: ne[ETA:5h] #--------------------------------------- 57/2520 error with tile https://nla.gov.au/nla_files/14/17_1.jpg: network error: HTTP status client error (404 Not Found) for url (https://nla.gov.au/nla_files/14/17_1.jpg) [ETA:5h] #--------------------------------------- 58/2520 error with tile https://nla.gov.au/nla_files/14/19_1.jpg: network error: HTTP status client error (404 Not Found) for url (https://nla.gov.au/nla_files/14/19_1.jpg) [ETA:5h] #--------------------------------------- 59/2520 error with tile https://nla.gov.au/nla_files/14/16_1.jpg: network error: HTTP status client error (404 Not Found) for url (https://nla.gov.au/nla_files/14/16_1.jpg) [ETA:5h] #--------------------------------------- 60/2520 error with tile https://nla.gov.au/nla_files/14/24_1.jpg: network error: HTTP status client error (404 Not Found) for url (https://nla.gov.au/nla_files/14/24_1.jpg) [2020-05-07T00:06:21Z WARN dezoomify_rs] Failed to load 'https://nla.gov.au/nla_files/14/33_1.jpg'. Retrying in 2.08s
lovasoa commented 4 years ago

Unfortunately, this website does not follow the usual tile URL pattern for deepzoom image tiles. You can still download your image using the generic dezoomer.

dezoomify-rs --retries 0 'https://nla.gov.au/nla.obj-2646882352/dzi?tile=13/{{X}}_{{Y}}.jpg'

map

macmacleannz commented 4 years ago

The National Library of Australia (NLA) actually encourages downloads. You can direct download high resolution images that are out of copyright. For example the above mas can be downloaded as a 2gb tiff file - https://nla.gov.au/tarkine/nla.obj-2646882352/m. Very easy to export the file id's (for example "nla.obj-2646882352"), and bulk download.