BULK UPLOAD: Boke, Kamsar, Kolaboui - GUINEA (19 datasets)

[sophialinn]

These may be a bit confusing regarding which city they belong to. They are all in the country of Guinea, and in the Boke-Kamsar region. There are some data specifically for Boke; only one dataset for Kamsar; and then a number of datasets for a settlement between those two called Kolaboui. The prefix for Boke is BOK; for Kamsar it's KAM; and for Kolaboui, I decided to use GUI_KOL (as I believe we used GUI to signify the entire region of Boke-Kamsar).

Here's the link to the data: https://drive.google.com/open?id=1wz5DWYbEtwiJMJqKHbYT2wfQHmkfEoIz

Here's the link to the metadata: https://drive.google.com/open?id=1VlNybwHq9KAyeepmPFopb4YqLA54Y8NXbxc5ZFma8OY

[kalxas]

Finished processing 19 layers in 1354.0 seconds.

16 Created layers
0 Updated layers
0 Skipped layers
3 Failed layers
71.263158 seconds per layer

[kalxas]

[failed] Layer for '/data/Boke-Kamsar_Data/BOK_Health_and_medicine.shp' (1/19)
[failed] Layer for '/data/Boke-Kamsar_Data/BOK_Shelter_and_Emergency.shp' (2/19)
[created] Layer for '/data/Boke-Kamsar_Data/GUI_KOL_OpenSpace.shp' (3/19)
[created] Layer for '/data/Boke-Kamsar_Data/GUI_KOL_Energy.shp' (4/19)
[created] Layer for '/data/Boke-Kamsar_Data/KAM_buildings.shp' (5/19)
[created] Layer for '/data/Boke-Kamsar_Data/GUI_KOL_COMMUNICATION.shp' (6/19)
[created] Layer for '/data/Boke-Kamsar_Data/BOK_Energy.shp' (7/19)
[created] Layer for '/data/Boke-Kamsar_Data/BOK_buildings.shp' (8/19)
[created] Layer for '/data/Boke-Kamsar_Data/GUI_KOL_Water_and_sanitation.shp' (9/19)
[created] Layer for '/data/Boke-Kamsar_Data/BOK_Water_and_Sanitation.shp' (10/19)
[created] Layer for '/data/Boke-Kamsar_Data/GUI_KOL_Economy_and_administrative_services.shp' (11/19)
[created] Layer for '/data/Boke-Kamsar_Data/BOK_Open_space.shp' (12/19)
[created] Layer for '/data/Boke-Kamsar_Data/GUI_KOL_Health_and_medicine.shp' (13/19)
[created] Layer for '/data/Boke-Kamsar_Data/BOK_Communication.shp' (14/19)
[failed] Layer for '/data/Boke-Kamsar_Data/BOK_Religion.shp' (15/19)
[created] Layer for '/data/Boke-Kamsar_Data/GUI_KOL_SHELTERS_AND_EMERGENCY_SERVICES.shp' (16/19)
[created] Layer for '/data/Boke-Kamsar_Data/GUI_KOL_Religions.shp' (17/19)
[created] Layer for '/data/Boke-Kamsar_Data/BOK_Economy_Admin_services.shp' (18/19)
[created] Layer for '/data/Boke-Kamsar_Data/GUI_KOL_EDUCATION.shp' (19/19)

[kalxas]

/data/Boke-Kamsar_Data/BOK_Health_and_medicine.shp
================
   File "/usr/local/lib/python2.7/site-packages/geonode/layers/models.py", line 540, in pre_sa
ve_layer
    base_file, info = instance.get_base_file()
  File "/usr/local/lib/python2.7/site-packages/geonode/layers/models.py", line 251, in get_ba
se_file
    self)
  File "/usr/local/lib/python2.7/site-packages/geonode/utils.py", line 980, in check_shp_colu
mnnames
    return fixup_shp_columnnames(inShapefile, layer.charset)
  File "/usr/local/lib/python2.7/site-packages/geonode/utils.py", line 1064, in fixup_shp_col
umnnames
    "Could not decode SHAPEFILE attributes by using the specified charset '{}'.".format(chars
et))
GeoNodeException: Could not decode SHAPEFILE attributes by using the specified charset 'UTF-8
'.

 /data/Boke-Kamsar_Data/BOK_Shelter_and_Emergency.shp
================
  File "/usr/local/lib/python2.7/site-packages/geonode/layers/models.py", line 540, [57/1844]
ve_layer
    base_file, info = instance.get_base_file()
  File "/usr/local/lib/python2.7/site-packages/geonode/layers/models.py", line 251, in get_ba
se_file
    self)
  File "/usr/local/lib/python2.7/site-packages/geonode/utils.py", line 980, in check_shp_colu
mnnames
    return fixup_shp_columnnames(inShapefile, layer.charset)
  File "/usr/local/lib/python2.7/site-packages/geonode/utils.py", line 1064, in fixup_shp_col
umnnames
    "Could not decode SHAPEFILE attributes by using the specified charset '{}'.".format(chars
et))
GeoNodeException: Could not decode SHAPEFILE attributes by using the specified charset 'UTF-8
'.

/data/Boke-Kamsar_Data/BOK_Religion.shp
================
     File "/usr/local/lib/python2.7/site-packages/geonode/layers/models.py", line 540, in pre_sa
ve_layer
    base_file, info = instance.get_base_file()
  File "/usr/local/lib/python2.7/site-packages/geonode/layers/models.py", line 251, in get_ba
se_file
    self)
  File "/usr/local/lib/python2.7/site-packages/geonode/utils.py", line 980, in check_shp_col$
mnnames
    return fixup_shp_columnnames(inShapefile, layer.charset)
  File "/usr/local/lib/python2.7/site-packages/geonode/utils.py", line 1064, in fixup_shp_co$
umnnames
    "Could not decode SHAPEFILE attributes by using the specified charset '{}'.".format(char$
et))
GeoNodeException: Could not decode SHAPEFILE attributes by using the specified charset 'UTF-$
'.        

[kalxas]

Boke: Buildings : Metadata updated!
Boke: Communication : Metadata updated!
Boke: Economic and Administrative Services : Metadata updated!
Boke: Energy : Metadata updated!
boke: health and medicine : Failed to update
Exception: Layer matching query does not exist.
Boke: Open Space : Metadata updated!
boke: religious facilities : Failed to update
Exception: Layer matching query does not exist.
boke: emergency shelters : Failed to update
Exception: Layer matching query does not exist.
Boke: Water And Sanitation : Metadata updated!
Kamsar: Buildings : Metadata updated!
Boke-Kamsar (Kolaboui): Communication : Metadata updated!
Boke-Kamsar (Kolaboui): Economic and Administrative Services : Metadata updated!
Boke-Kamsar (Kolaboui): Education : Metadata updated!
Boke-Kamsar (Kolaboui): Energy : Metadata updated!
Boke-Kamsar (Kolaboui): Health and Medical Facilities : Metadata updated!
Boke-Kamsar (Kolaboui): Open Space : Metadata updated!
Boke-Kamsar (Kolaboui): Religious Facilities : Metadata updated!
Boke-Kamsar (Kolaboui): Emergency Shelters : Metadata updated!
Boke-Kamsar (Kolaboui): Water and Sanitation : Metadata updated!

[kalxas]

@sophialinn ready for review

[sophialinn]

@kalxas Looks like there are spaces in some of the attribute names. Would that cause this failure?

[kalxas]

yes, it could be the cause

[kalxas]

one other thing: the city filter is now populated with more city names about Boke, I hope this is what we want :)

[sophialinn]

Yes, that's kind of a known problem, and one we don't really know how to deal with. We have "Boke", "Kamsar", "Boke-Kamsar" and "Guinea"

[sophialinn]

The attribute table for Bok_Religion doesn't open at all and throws an error I've never seen before:

The other two, as mentioned, have spaces in the attribute name and even an apostrophe (') BUT I checked other functioning layers and there are those irregularities too, so that's not likely the problem.