B1G Harvest: handle poorly formed URIs

geoblacklight / geoblacklight_sidecar_images

Store local copies of remote imagery in GeoBlacklight

Apache License 2.0

4 stars 3 forks source link

B1G Harvest: handle poorly formed URIs #7

Closed ewlarson closed 4 years ago

ewlarson commented 6 years ago

Some URIs are poorly formed and the http fetch isn't happy.

StoreImageJob (Job ID: ed0e8fda-7bde-475e-ad7a-70c68d086aff) from Sidekiq(default) in 5241.93ms: URI::InvalidURIError (bad URI(is not URI?): http:/data.pgc.umn.edu/maps/antarctica/usgs/06/preview/Deep Freeze Range.jpg):

ewlarson commented 6 years ago

Use the Addressable gem.

ewlarson commented 4 years ago

Related Geoportal entry: https://geo.btaa.org/catalog/ANT-REF-ML2506-001/admin

ewlarson commented 4 years ago

Closing. Already using addressable to parse URIs:

https://github.com/geoblacklight/geoblacklight_sidecar_images/blob/11ae28e4767b2fae69f5cc2cb1374c82e5dfcb7c/app/services/geoblacklight_sidecar_images/image_service.rb#L123-L131