search

bcgov / FIT_opendatadownloader

Monitor open data, report when changes are detected
Apache License 2.0
0 stars 0 forks source link

handle AGOL layers #4

Closed smnorris closed 3 weeks ago

smnorris commented 3 weeks ago

Data at https://governmentofbc.maps.arcgis.com/sharing/rest/content/items/4bba119c2e9042d683cc9378fb1e836e/data does not download successfully via ogr. It seems like a config flag is required to correctly handle the redirect to s3 (with token), but I can't tell what that might be.

https://github.com/bcgov/FIT_changedetector/actions/runs/10586427816/job/29335160728

smnorris commented 3 weeks ago

This is an issue with ogr.

will be fixed per https://github.com/OSGeo/gdal/pull/10663. Workaround with existing versions:

$ ogrinfo "/vsizip/{/vsicurl/https://governmentofbc.maps.arcgis.com/sharing/rest/content/items/4bba119c2e9042d683cc9378fb1e836e/data}/CoL_TransportationNetwork Jan 3 2024.gdb"
INFO: Open of `/vsizip/{/vsicurl/https://governmentofbc.maps.arcgis.com/sharing/rest/content/items/4bba119c2e9042d683cc9378fb1e836e/data}/CoL_TransportationNetwork Jan 3 2024.gdb'
      using driver `OpenFileGDB' successful.
Layer: TRN_BRIDGES (Point)
Layer: TRN_DISASTER_RESPONSE_ROUTES (Multi Line String)
Layer: TRN_MEDIANS (Multi Polygon)
Layer: TRN_RAILWAY (Multi Line String)
Layer: TRN_SIDEWALKS (Multi Line String)
Layer: TRN_STREETNAMES (Multi Polygon)
Layer: TRN_BICYCLE_ROUTES (Multi Line String)
Layer: TRN_ROADS (Multi Line String)