search

GeoEra-GIP / Project-Support-WP8

Science Project Data provider support
https://geoera-gip.github.io/support/
7 stars 2 forks source link

Data Download EGDI #770

Open fire-bot opened 1 year ago

fire-bot commented 1 year ago

Sent by Stokes, Lesley

[OFFICIAL]

Hey there, my name is Lesley Stokes with Anglo American and I’m having trouble downloading some specific datasets using your EGDI Geoera Mintell4eu portal. I filtered the data down to four main commodities – Au, Cu, Ag, Zn. I managed to join the minoccurence database view to the commodity table (using the mineraloccurrencesbk column), and when I symbolized and filtered the data to show only the Au, Cu, Ag, and Zn it was clear that I’m missing many data points. For example, the data I want to download is shown in the picture on the tpo, but what I’m getting is the picture on the bottom. Could you help explain what I’m doing wrong? Thank you!!

![Map

Description automatically generated](https://firebot-prod-media.s3.amazonaws.com:443/email-attachments/c8c8b189-46d7-4b5f-8c5a-bc87a0ff62ea/image001.png)

Lesley Stokes

Geospatial Information Specialist – North America

nmtoken commented 1 year ago

possibly related to https://github.com/GeoEra-GIP/Project-Support-WP8/issues/618

mh-geus-dk commented 1 year ago

Form the picture I can't see which took you are using, so it is very difficult to help. /Martin

nmtoken commented 1 year ago

requested clarification from user

nmtoken commented 1 year ago

User reports they were working on (providing the URL) GeoERA Mintell4eu portal

and attempting to download a queried service (filtered to All deposit occurrences – base metals – commodity Au, Cu, Pb, Zn, Ag) using the Desktop GIS – download option provided.

The issue is that: when I download the data, it appears as though many of the underlying database source links are broken and the data is either missing points and/or attributes

nmtoken commented 1 year ago

If I look at the link provided, I can't see the options reported by the user, possibly that's an issue of the bookmark details not being restored when opening a new window from fresh. In the map provided by the user the download option gives a GeoJSON export that doesn't include a mineraloccurrencesbkcolumn. I can see such a column in a GeoPackage download.

nmtoken commented 1 year ago

Customer reports:

Oops, you’re right. I’m not meaning to query the mines layer – just the mineral occurrences! So “All deposit occurrences – base metals – commodity Au, Cu, Pb, Zn, Ag” and downloading using the Desktop GIS – download option to get the geopackage. When I open the geopackage it appears as tho nothing has been filtered out. I see a main.mineraloccurence SQL Lite Feature class and a variety of tables, including a commodity table. When I join the Commodity Table with the Main.Mineraloccurence feature class and filter the data to Au-Cu-Pb-Zn-Ag I only get about 3,863 points (see image below), as opposed to what I see on the EGDI online map which is quite different! I’m not quite sure what I’m doing wrong and I wonder if the download tool is extracting all the data.

I can see in the commodity table here are multiple rows of data for the single Min Occ Bk number, could that be it I wonder? I will try to consolidate those rows and see if they show up. I know in pro, if there’s more than one record it’ll omit drawing the point all together. May try in ArcMap and see.

nmtoken commented 1 year ago

I wonder if the download tool is extracting all the data.

I assume that's expected behaviour. The download option gives a copy of the original uploaded data with no filtering. and that filtering only works on data in the system database.

mh-geus-dk commented 1 year ago

Hi James,

The downloaded GeoPackage always contains the data as they were delivered. The GeoPackage might contain several spatial elements and thematisation.

Cheers, martin

Fra: James Passmore @.> Sendt: 23. februar 2023 18:27 Til: GeoEra-GIP/Project-Support-WP8 @.> Cc: Martin Hansen @.>; Assign @.> Emne: Re: [GeoEra-GIP/Project-Support-WP8] Data Download EGDI (Issue #770)

I wonder if the download tool is extracting all the data.

I assume that's expected behaviour. The download option gives a copy of the original uploaded data with no filtering

— Reply to this email directly, view it on GitHubhttps://github.com/GeoEra-GIP/Project-Support-WP8/issues/770#issuecomment-1442161134, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AQB5EUP4BF7PHWBU3IFQ7MDWY6MVBANCNFSM6AAAAAAT5HR4KA. You are receiving this because you were assigned.Message ID: @.***>

nmtoken commented 1 year ago

Thanks for confirming, I'll report back to the external user.

Is it also correct that the filter tool only works in the GUI, and that there is no way to get the results of the filtering as a download?

What are the relationships between the data exposed in the GUI and the uploaded data. Is it possible that the GUI filtering works on more than one uploaded dataset, so it isn't possible to replicate the GUI filtering by downloading just one file; sorry it isn't clear to me.

nmtoken commented 1 year ago

The m4eu20211209.gpkg download from the Mineral occurrences is all data from the homogenized Minerals 4EU and EURare projects ~ a single database with data from multiple sources, all with different local data models, transformed to the EarthResourceML data model