search

UWM-Libraries / GeoDiscovery-Utils

Repo for GeoDiscovery middleware
Apache License 2.0
1 stars 2 forks source link

Download Links in Harvested Records - Unwanted downloads #19

Open srappel opened 2 months ago

srappel commented 2 months ago

This record links directly to a download. Probably not what people want to happen. I will have to check this out.

image

srappel commented 2 months ago

This will probably require changes in the DCAT harvester script, so this issue should really be over in GeoDiscovery-Utils.

srappel commented 2 months ago

https://data2017-04-05t135915451z-waupacacounty.opendata.arcgis.com/documents/waupacacounty::2018-contours-north-eastern-quadrant-shp/about

Another example from Waupaca.

We could look in the DCAT to see if the Landing Page URL matches the Distribution > Shapefile > accessURL link?

"@type": "dcat:Dataset",
            "identifier": "https://www.arcgis.com/home/item.html?id=de17272ab3e6434f950e4b8b17908bc8",
            "landingPage": "https://data2017-04-05t135915451z-waupacacounty.opendata.arcgis.com/documents/waupacacounty::2018-contours-north-eastern-quadrant-shp",
            "title": "2018 Contours - North Eastern Quadrant (.shp)",
            "description": "<span style='overflow: auto;'><span><span style='color: rgb(0, 0, 205);'><font size='4'><span style='font-weight: bold;'>703 MB ZIP FILE Contains Shapefiles.  </span></font></span></span></span><font size='3'><span style='color: rgb(0, 0, 0);'><span style='overflow: auto;'><span><span style='overflow: auto;'><span>Elevation </span></span><span style='overflow: auto;'><span><span style='overflow: auto;'><span><span style='overflow: auto;'><span>values are referenced to NADV88.  </span></span></span></span></span></span></span></span></span></font><font size='3'><span style='color: rgb(0, 0, 0);'><span style='overflow: auto;'><span><span style='overflow: auto;'><span><span style='overflow: auto;'><span><span style='overflow: auto;'><span><span style='overflow: auto;'><span><span style='overflow: auto;'><span><span style='overflow: auto;'><span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></font>",
            "keyword": [
                "Open Data",
                "Elevation"
            ],
            "issued": "2019-07-09T16:54:00.000Z",
            "modified": "2019-07-12T20:37:31.000Z",
            "publisher": {
                "name": "Waupaca County Land Information"
            },
            "contactPoint": {
                "@type": "vcard:Contact",
                "fn": "WaupacaCounty_LIO",
                "hasEmail": "mailto:jason.mckeefry@co.waupaca.wi.us"
            },
            "accessLevel": "public",
            "spatial": "-89.3348,44.2259,-88.3440,44.6891",
            "license": "http://creativecommons.org/licenses/by/4.0",
            "distribution": [
                {
                    "@type": "dcat:Distribution",
                    "title": "ArcGIS Hub Dataset",
                    "format": "Web Page",
                    "mediaType": "text/html",
                    "accessURL": "https://data2017-04-05t135915451z-waupacacounty.opendata.arcgis.com/documents/waupacacounty::2018-contours-north-eastern-quadrant-shp"
                },
                {
                    "@type": "dcat:Distribution",
                    "title": "ArcGIS GeoService",
                    "format": "ArcGIS GeoServices REST API",
                    "mediaType": "application/json",
                    "accessURL": "https://wclio-lidar-2018.s3.amazonaws.com/Contours/shp/WCGIS_2018_Contours_ne_shp.zip"
                }
            ],
            "theme": [
                "geospatial"
srappel commented 2 months ago

In all honesty, this isn't a huge issue. Here is the above dataset on Geodata@Wisconsin... it does the same thing:

https://geodata.wisc.edu/catalog/WaukeshaCounty-8218c3405342459c8513143c2f5239e4

srappel commented 1 month ago

BTAA handles links really well:

Image