whosonfirst-data / whosonfirst-data

Who's On First is a gazetteer of places.
http://www.whosonfirst.org/
Other
423 stars 9 forks source link

[hierarchy] European union - new NUTS 2016 classification - valid from 1 January 2018 #1209

Closed ImreSamu closed 1 year ago

ImreSamu commented 6 years ago

The EU territorial code system was modified on 1 January 2018.

The " current NUTS 2016 classification is valid from 1 January 2018 and lists 104 regions at NUTS 1, 281 regions at NUTS 2 and 1348 regions at NUTS 3 level." see more : http://ec.europa.eu/eurostat/web/nuts/background

details: http://ec.europa.eu/eurostat/documents/345175/629341/NUTS2013-NUTS2016.xls

NUTS 1 changes ( major socio-economic regions)

Code 2013 Code 2016 Label Change Explanation (new = old)
FRB CENTRE — VAL DE LOIRE new NUTS 1 region, identical to ex-NUTS 2 region FR24 FRB=FR24
FRC BOURGOGNE-FRANCHE-COMTÉ new NUTS 1 region, merge of ex-NUTS 2 regions FR26 and FR43 FRC=FR26+FR43
FRD NORMANDIE new NUTS 1 region, merge of ex-NUTS 2 regions FR23 and FR25 FRD=FR23+FR25
FRE NORD-PAS DE CALAIS-PICARDIE new NUTS 1 region, merge of ex-NUTS 2 regions FR22 and FR30 FRE=FR22+FR30
FRF ALSACE-CHAMPAGNE-ARDENNE-LORRAINE new NUTS 1 region, merge of ex-NUTS 2 regions FR 21, FR 41 and FR42 FRF=FR21+FR41+FR42
FRG PAYS DE LA LOIRE new NUTS 1 region, identical to ex-NUTS 2 region FR51 FRG=FR51
FRH BRETAGNE new NUTS 1 region, identical to ex-NUTS 2 region FR52 FRH=FR52
FRI AQUITAINE-LIMOUSIN-POITOU-CHARENTES new NUTS 1 region, merge of ex-NUTS 2 regions FR53, FR61 and FR63 FRI=FR53+FR61+FR63
FRJ LANGUEDOC-ROUSSILLON-MIDI-PYRÉNÉES new NUTS 1 region, merge of ex-NUTS 2 regions FR62 and FR81 FRJ=FR62+FR81
FR7 FRK AUVERGNE-RHÔNE-ALPES relabelled and recoded FRK=FR7
FRL PROVENCE-ALPES-CÔTE D’AZUR new NUTS 1 region, identical to ex-NUTS 2 region FR82 FRL=FR82
FRM CORSE new NUTS 1 region, identical to ex-NUTS 2 region FR83 FRM=FR83
FRA FRY RUP FR — RÉGIONS ULTRAPÉRIPHÉRIQUES FRANÇAISES relabelled and recoded FRY=FRA
FR2 Bassin Parisien discontinued
FR3 Nord-Pas-de-Calais discontinued
FR4 Est discontinued
FR5 Ouest discontinued
FR6 Sud-Ouest discontinued
FR7 Centre-Est discontinued
FR8 Méditerranée discontinued
PL1 REGION CENTRALNY discontinued
PL2 PL2 MAKROREGION POŁUDNIOWY relabelled PL2=PL2
PL3 REGION WSCHODNI discontinued
PL4 PL4 MAKROREGION PÓŁNOCNO-ZACHODNI relabelled PL4=PL4
PL5 PL5 MAKROREGION POŁUDNIOWO-ZACHODNI relabelled PL5=PL5
PL6 PL6 MAKROREGION PÓŁNOCNY relabelled PL6=PL6
PL7 MAKROREGION CENTRALNY new region, made from ex-PL11 and PL33 PL7=PL11+PL33
PL8 MAKROREGION WSCHODNI new region, equals ex-PL3 minus PL33 PL8=PL3-PL33
PL9 MAKROREGION WOJEWÓDZTWO MAZOWIECKIE new region, equals ex-PL12 PL9=PL12

NUTS 2 changes (basic regions for the application of regional policies )

Code 2013 Code 2016 Label Change Explanation (new = old)
IE01 Border, Midland and Western discontinued
IE04 Northern and Western new region
IE02 Southern and Eastern discontinued
IE05 Southern new region, made from ex-IE023, IE024 and IE025 IE05=IE023+IE024+IE025
IE06 Eastern and Midland new region
FR24 FRB0 Centre — Val de Loire recoded and relabelled FRB0=FR24
FR26 FRC1 Bourgogne recoded FRC1=FR26
FR43 FRC2 Franche-Comté recoded FRC2=FR43
FR25 FRD1 Basse-Normandie recoded FRD1=FRFR25
FR23 FRD2 Haute-Normandie recoded FRD2=FR23
FR30 FRE1 Nord-Pas de Calais recoded FRE1=FR30
FR22 FRE2 Picardie recoded FRE2=FR22
FR42 FRF1 Alsace recoded FRF1=FR42
FR21 FRF2 Champagne-Ardenne recoded FRF2=FR21
FR41 FRF3 Lorraine recoded FRF3=FR41
FR51 FRG0 Pays de la Loire recoded FRG0=FR51
FR52 FRH0 Bretagne recoded FRH0=FR52
FR61 FRI1 Aquitaine recoded FRI1=FR61
FR63 FRI2 Limousin recoded FRI2=FR63
FR53 FRI3 Poitou-Charentes recoded FRI3=FR53
FR81 FRJ1 Languedoc-Roussillon recoded FRJ1=FR81
FR62 FRJ2 Midi-Pyrénées recoded FRJ2=FR62
FR72 FRK1 Auvergne recoded FRK1=FR72
FR71 FRK2 Rhône-Alpes recoded FRK2=FR71
FR82 FRL0 Provence-Alpes-Côte d’Azur recoded FRL0=FR82
FR83 FRM0 Corse recoded FRM0=FR83
FRA1 FRY1 Guadeloupe recoded FRY1=FRA1
FRA2 FRY2 Martinique recoded FRY2=FRA2
FRA3 FRY3 Guyane recoded FRY3=FRA3
FRA4 FRY4 La Réunion recoded FRY4=FRA4
FRA5 FRY5 Mayotte recoded FRY5=FRA5
LT00 Lietuva split into new LT01 and LT02
LT01 Sostinės regionas new region, equals ex-NUTS 3 region LT00A LT01=LT00A
LT02 Vidurio ir vakarų Lietuvos regionas new region, ex-LT00 minus ex-LT00A LT02=LT00-LT00A
HU10 Közép-Magyarország discontinued; split into new HU11 and HU12
HU11 Budapest new region, equals ex-NUTS 3 region HU101 HU11=HU101
HU12 Pest new region, equals ex-NUTS 3 region HU102 HU12=HU102
PL11 PL71 Łódzkie recoded PL71=PL11
PL33 PL72 Świętokrzyskie recoded PL72=PL33
PL31 PL81 Lubelskie recoded PL81=PL31
PL32 PL82 Podkarpackie recoded PL82=PL32
PL34 PL84 Podlaskie recoded PL84=PL34
PL12 Mazowieckie discontinued; split into new PL91 and PL92
PL91 Warszawski stołeczny new region, equals ex-PL127, PL129 and PL12A minus new PL926 PL91=PL127+PL129+PL12A-newPL926
PL92 Mazowiecki regionalny new region, made from ex-PL128, PL12B, PL12C, PL12D, PL12E plus new PL926 PL92=PL128+PL12B+PL12C+PL12D+PL12E+new PL926
UKM2 UKM7 Eastern Scotland boundary shift; lost ex-UKM24 UKM7=UKM2-UKM24
UKM3 South Western Scotland discontinued; split into new UKM8 and UKM9
UKM8 West Central Scotland new region, made from ex-UKM31, UKM34, UKM35 and UKM36 UKM8=UKM31+UKM34+UKM35+UKM36
UKM9 Southern Scotland new region, made from ex-UKM24, UKM32, UKM33, UKM37 and UKM38 UKM9=UKM24+UKM32+UKM33+UKM37+UKM38

NUTS 3 changes ( small regions for specific diagnoses )

... see XLS http://ec.europa.eu/eurostat/documents/345175/629341/NUTS2013-NUTS2016.xls

special comment for Hungary

the official info about the changes : https://www.ksh.hu/regional_atlas_counties?lang=en but the wikipedia pages not yet updated ( be careful! ) https://en.wikipedia.org/wiki/NUTS_statistical_regions_of_Hungary

ImreSamu commented 6 years ago

the proposed mappings ( EU - WOF placetypes )

EU hierarchical system whosonfirst placetype comment
NUTS0 country 28 country
NUTS1 macroregion 104 regions at NUTS 1
NUTS2 region 281 regions at NUTS 2
NUTS3 ~county 1348 regions at NUTS 3 level.
LAU ( Local Administrative Units) locality localadmin 99 759
nvkelso commented 6 years ago

@ImreSamu Hey! Good to have you back working on Who's On First :)

Your proposal in https://github.com/whosonfirst-data/whosonfirst-data/issues/1209#issuecomment-394097604 generally looks workable except for LAU generally mapping to WOF's localadmin placetype (good) instead of locality (bad).

NOTE: I expect that not all LAU will be included in WOF at present, but almost all NUTS0, NUTS1, NUTS2, and NUTS3 should be. Does NUTS now include geometry for these at least as a centroid that we could import under CC0 or CC-BY to have the full set of features?

How would we add this data to WOF? At first I thought as a new set of concordances (with a nuts2016 namespace), but NUTS regions often span administrative units so it's not a 1:1 mapping. So maybe as a new nuts2016 property prefix and then property keys of nuts0, nuts1 & etc? For example: nuts2016:nuts0 = HU, nuts2018:nuts1 = HU01 (made up values).

This will require sources repo work and properties repo work. The sources repo description should specify that even though the prefix is nuts2016 it's only valid from 2018+?

Is there a reason to add the earlier NUTS codes, too?

/cc @stepps00.

ImreSamu commented 6 years ago

@nvkelso ! Thank for your answer and corrections ( -> "LAU = localadmin placetype " )

now I am still researching ...

my plan:

How would we add this data to WOF?

Let's discuss this topic - later. :smile:

ImreSamu commented 6 years ago

Geodata licensing :

I have received some information[1], but as I see - it is not OK for the project

[1] LAU data : http://ec.europa.eu/eurostat/web/gisco/geodata/reference-data/administrative-units-statistical-units/communes#commcentroids10

from the FAQ:

Q. Which are the rules and constraints for the usage of data for commercial purposes? A. Eurostat, being a license holder of the geospatial data coming from EuroGeographics, is not allowed to assign the rights for the usage of data. Our license agreement only covers non-commercial use. Please contact www.eurogeographics.org to obtain a license for commercial use.

http://ec.europa.eu/eurostat/web/gisco/faq


still researching ...

nvkelso commented 6 years ago

@ImreSamu We can still use the data you pointed at to add concordances to and validate our own data for the same. In terms of matching it up (for the concordances), could you see which countries have what % matches and propose a concordances PR?

Then for countries:

@stepps00 is also working on a GeoNames import that would bring in more localadmin records, too.

ImreSamu commented 6 years ago

There are a brand new ( 2018 ) version of the EU LAU list https://ec.europa.eu/eurostat/documents/345175/501971/EU-28-LAU-2018-NUTS-2016.xlsx

And I have created a simple wof-lau count(*) comparison by wof_country: https://gist.github.com/ImreSamu/237f86f7728bee94f24e4ff2a3559bff ( WOF last git log: Mon Sep 17 18:03:10 2018 -0700 )

( Thinking about this problem ) imho : We can use the data in 2 ways

At least (the importing) only working for this countries ( ~ active local Wikidata community )

country LAU code mapping label
AT P964 Austrian municipality key
DE P439 German municipality key
ES P772 INE municipality code
FR P374 INSEE municipality code
HU P939 KSH code
IT P635 ISTAT ID
SE P525 Swedish municipality code
SK P782 LAU

I have wrote some draft SQL - and ~99.6% match

As I see -at least the Hungarian WOF data can be fixed with this method.

nvkelso commented 6 years ago

Rad! Sounds like a good plan :)

But looking at your Gist I wonder if we should first agree what WOF placetype matched up to what EU_LAU as I don't think they're always locality, sometimes county, sometimes localadmin?

@stepps00 Can you link the placetype per country sheet here?

stepps00 commented 6 years ago

Here is a breakdown of placetypes per country I compiled through recent placetype cleanup: https://github.com/whosonfirst/whosonfirst-cookbook/blob/master/definition/placetypes_by_country.md

Open to changing this if we recognize an issue.

ImreSamu commented 6 years ago

But looking at your Gist I wonder if we should first agree what WOF placetype matched up to what EU_LAU as I don't think they're always locality, sometimes county, sometimes localadmin?

yes, it is different country-by-country

imho: we need country-by-country metadata rules - for comparing with other databases

@stepps00 : thank you ;

draft - Hungary ( metadata ):

example:

Wikidata admin codes

There are lot of 'Wikidata property for authority control for administrative subdivisions' and I need a country specific wof-wikidata metadata for fine matching.

wikidata query - for actual - admin properties: http://tinyurl.com/y7r23dpu

example:

...
 -CBS municipality code (P382)
 -dantai code (P429)
 -German municipality key (P439)
 -German district key (P440)
 -China administrative division code (P442)
 -Swedish county code (P507)
 -Swedish municipality code (P525)
 -NUTS code (P605)
 -ISTAT ID (P635)
 -OKATO ID (P721)
 -OKTMO ID (P764)
 -Swiss municipality code (P771)
 -INE municipality code (P772)
 -ISO 3166-3 (P773)
 -FIPS 55-3 (locations in the US) (P774)
 -LAU (P782)
 -Italian cadastre code (P806)
 -FIPS 10-4 (countries and regions) (P901)
 -KSH code (P939)
 -Austrian municipality key (P964)
 -Thailand central administrative unit code (P1067)
 -KOATUU identifier (P1077)
 -ATVK ID (P1115)
 -ELSTAT geographical code (P1116)
 -EHAK id (P1140)
...
nvkelso commented 1 year ago

NUTS 2021 is out now... and there are a few other issues that track this now for: