nsidc / qgreenland

Source code for generating the QGreenland package hosted at https://qgreenland.org/
https://qgreenland.readthedocs.io
Other
36 stars 9 forks source link

Update place names layer (Asiaq) #553

Closed trey-stafford closed 1 year ago

trey-stafford commented 1 year ago

We want to update the Asiaq place names layer ("Places/Towns and settlements") because there are a number of noted data issues.

trey-stafford commented 1 year ago

According to Martin E. at Asaiq, we may already have the most up-to-date version of the data. However, he pointed me to this resource, which he thinks is based on the same dataset we already have: https://kort.nunagis.gl/portal/home/item.html?id=d9cf6eb788134a229076a8c855765e8c

That link itself links to an image service (MapServer...looks like the interface is ArcGIS hosted though), which is composed of two source layers:

I have been unsuccessful in fetching the source data for either of these layers (attempting to use the "query" interface returns a 404).

trey-stafford commented 1 year ago

This URL appears to work for querying the settlements layer: https://kort.nunagis.gl/refserver/rest/services/Kortportal/Byer_og_bygder/MapServer/0/query/?f=json&where=OBJECTID+is+not+null&outFields=*&orderByFields=OBJECTID+ASC&returnGeometry=true&featureEncoding=esriDefault

trey-stafford commented 1 year ago

PR to add place names from Asiaq/NunaGIS: https://github.com/nsidc/qgreenland/pull/570

MattF-NSIDC commented 1 year ago

@twilamoon-science can we pay someone to re-translate this dataset?

Background: We paid for someone to translate an earlier version of this placenames dataset to English, but a newer, more accurate version was released and it doesn't have English translations.

We can programmatically transfer translations from the old dataset where text matches exactly, but there will be new records and text changes.

trey-stafford commented 1 year ago

Reviewing Jira tickets, I see we had a note about investigating "translation as a service" (QGR-56). We might be able to leverage e.g., Google Translate API to provide rough translations for layers w/ attributes where Danish is used (it does not support translation to/from Greenlandic, however).

trey-stafford commented 1 year ago

Lets try to use our existing translations. Can we just adjust our preprocess script to join our translations to the latest version of cities/settlements?

twilamoon-science commented 1 year ago

If this process looks promising, we can use it for the QGreenland layer and ask Asiaq if they would consider amending their dataset of record to include the translated version also.

trey-stafford commented 1 year ago

I reviewed our translation process for the original Asiaq placenames database and found that most of the translation work cannot be applied to the updated place names layers we pull from NunaGIS.

The Asiaq placenames database includes placenames for various points of interest (e.g., lakes, beaches, radio stations, places to pick berries, etc.). These object designations are what we have translations for. The cities and settlements layers pulled from NunaGIS are just that - cities and settlements.

Moreover, the new cities and settlements layers have fewer fields than the original Asiaq placenames database. The newly updated layers have fields for:

The original placenames database also included fields for:

The one thing we can translate is the field names (e.g., "Ny grønlandsk" -> "New Greenlandic").

MattF-NSIDC commented 1 year ago

The Asiaq placenames database includes placenames for various points of interest (e.g., lakes, beaches, radio stations, places to pick berries, etc.). These object designations are what we have translations for.

Didn't get this at first, but looking at the translation data helped. An example translation record:

ANKER,"Ankerplads, naturlig havn",Umiatsialivilik,11,"Anchorplace, natural harbor"
trey-stafford commented 1 year ago

The new layers added in the associated PR also include a population (2016) field. This may meet the requirements of https://github.com/nsidc/qgreenland/issues/596

There have definitely been changes in population since 2016, but at least this might give those who are looking an idea of numbers. E.g, The settlement of Illorsuit has a population (2016) of 75. However, we know that Illorsuit was abandoned in 2017 due to a landslide and tsunami event.

trey-stafford commented 1 year ago

Now ready for review: https://github.com/nsidc/qgreenland/pull/570