AtlasOfLivingAustralia / layers-service

Spatial layers - this repo for issues/doc only, not code
3 stars 4 forks source link

Load layer - ABS Census Counts by Indigenous Region - 2006-2011 #80

Closed ansell closed 8 years ago

ansell commented 8 years ago

Data provided by the ABS from the 2006 and 2011 censuses:

Table 04: Census Counts by Indigenous Region—2006 - 2011 on the following page:

http://www.abs.gov.au/AUSSTATS/abs@.nsf/DetailsPage/2075.02011?OpenDocument

Excel file is at:

http://www.abs.gov.au/AUSSTATS/subscriber.nsf/log?openagent&20750%20table%204%20census%20counts%20by%20indigenous%20region%202006-2011.xls&2075.0&Data%20Cubes&385A95C7872CB69ACA257A3F00124DB8&0&2011&19.07.2012&Previous

Needs to be merged with the shapefile loaded in issue #78 into a new shapefile before loading.

ansell commented 8 years ago

Registered and downloaded Aboriginal and Torres Strait Islander Peoples (Indigenous) profile (including ESRI shapefiles) as a datapack from:

https://www.censusdata.abs.gov.au/datapacks/DataPacks?release=2011

CC-BY-2.5-Australia license attached to all of the data files in the datapack.

http://creativecommons.org/licenses/by/2.5/au/

ansell commented 8 years ago

One proof of concept layer from the I01A dataset distributed in the ABS DataPack uploaded. Currently contains two fields, one for the area name and one for the number of indigenous people, created from the ABS data:

http://spatial-test.ala.org.au/spatial-service/manageLayers/field/cl110849

Methodology is not yet automated so we can't perform the same task easily for all 3000+ fields in the datapack but we can easily pick a small number of interesting fields and upload them.

ansell commented 8 years ago

Had to remove the layer above as it was not functioning as expected. In particular, there is no capability for uploading a vector file and having it transformed to a raster environmental layer, so needed to develop that capability separately.

New layer to replace the one above is currently being generated at:

http://spatial-test.ala.org.au/spatial-service/manageLayers/field/el10851

Once that one is complete and verified the other layers can be created and uploaded to spatial-test.

Specifically, Tot_p_Indig_P, Tot_p_NonInd_P, and Tot_p_TotP need to have layers generated and uploaded from I01A, and Lsh_Austn_Indig_Lang_TotP needs to have a layer generated and uploaded from I01B

I would also like to generate density plots from each of those fields and upload them, as the raw numbers without taking into account the AREA_SQKM variable are not necessarily useful in all cases, where the density could be useful in some of those cases.

ansell commented 8 years ago

Indigenous population density layer currently being created as:

http://spatial-test.ala.org.au/spatial-service/manageLayers/field/el10852

ansell commented 8 years ago

Even though this layer is referring to numbers and not names/identifiers as with most vector layers, the ALA policy is to represent these numbers using vector layers and not raster layers because the subject matter is physical person numbers and not environmental chemical or physical measurements. Hence, the environmental layers above will be removed after they complete loading and they will be replaced with vector versions.

ansell commented 8 years ago

Removed the previous layers and attempting to do this again as a vector layer rather than a raster layer:

http://spatial-test.ala.org.au/spatial-service/manageLayers/layer/10856

ansell commented 8 years ago

This needs slight remapping to map against the PSMA Administrative Boundaries version that has slightly different field names.

ansell commented 8 years ago

This is now included in the list of PSMA fields in issue #81 so closing this issue and will work on it further there.