search

state-hiu / 2C-GeoNode

3 stars 9 forks source link

BULK REMOVAL AND NEW UPLOAD: Pokhara (25 datasets) #203

Open sophialinn opened 5 years ago

sophialinn commented 5 years ago

We need to REMOVE 24 datasets currently on the 2C GeoNode and replace them with updated 25 datasets for Pokhara. This is NOT a clean 'replace' because the filenames are slightly different; the prefix of the 'old' data is "pokhara" and the prefix for the new data is "POK", even though the nature of the data is probably the same. For this reason, we need to REMOVE the old, and then upload the new.

Please REMOVE the datasets listed in this spreadsheet: https://docs.google.com/spreadsheets/d/1L-ddQbUL4c966kAa6RxO6mz1Yc4_HSvsyPcmtbsN3Ck/edit?usp=sharing

And then UPLOAD the new data and metadata found here: https://drive.google.com/drive/folders/0B2Oc3HZSI7QFUFQ2RWd4WmxYb0E?usp=sharing

kalxas commented 5 years ago 
[SUCESS] Layer [pokhara_atm] deleted
[SUCESS] Layer [pokhara_banks] deleted
[SUCESS] Layer [pokhara_commercialbanks] deleted
[SUCESS] Layer [pokhara_developmentbanks] deleted
[SUCESS] Layer [pokhara_financecompanies] deleted
[ERROR] Layer [pokhara_financecompanies] couldn't be deleted
[SUCESS] Layer [pokhara_fuelstations] deleted
[SUCESS] Layer [pokhara_governmentoffices] deleted
[SUCESS] Layer [pokhara_ngo] deleted
[SUCESS] Layer [pokhara_hospitals] deleted
[SUCESS] Layer [pokhara_healthposts] deleted
[SUCESS] Layer [pokhara_pharmacies] deleted
[SUCESS] Layer [pokhara_clinics] deleted
[SUCESS] Layer [pokhara_dentist] deleted
[SUCESS] Layer [pokhara_schools] deleted
[SUCESS] Layer [pokhara_wardboundary] deleted
[SUCESS] Layer [pokhara_rivercanals] deleted
[SUCESS] Layer [pokhara_roadnetwork] deleted
[SUCESS] Layer [pokhara_trunkroad] deleted
[SUCESS] Layer [pokhara_primaryroad] deleted
[SUCESS] Layer [pokhara_secondaryroad] deleted
[SUCESS] Layer [pokhara_tertiaryroad] deleted
[SUCESS] Layer [pokhara_residentialroad] deleted
[SUCESS] Layer [pokhara_lakes] deleted
sophialinn commented 5 years ago

@kalxas The number of Pokhara data layers and metadata should line up now. Here are the links:

Pokhara Data: https://drive.google.com/drive/folders/0B2Oc3HZSI7QFMUNJYkhKaURwTEE?usp=sharing

Pokhara Metadata: https://drive.google.com/drive/folders/0B2Oc3HZSI7QFMUNJYkhKaURwTEE?usp=sharing

kalxas commented 5 years ago 
Finished processing 65 layers in 4107.0 seconds.

50 Created layers
0 Updated layers
1 Skipped layers
14 Failed layers
63.184615 seconds per layer
kalxas commented 5 years ago 
Pokhara: Automated Teller Machines : Metadata updated!                                       
Pokhara: Banks : Metadata updated!                                                           
Pokhara: Co-operative Banks : Metadata updated!                                              
Pokhara: Commercial Banks (Class A) : Metadata updated!                                      
Pokhara: Development Banks (Class B) : Metadata updated!
Pokhara: Finance Companies (Class C) : Metadata updated!
Pokhara: Micro Finance Development Banks(Class D) : Metadata updated!
pokhara: drinking water pipeline network : Failed to update
Exception: Layer matching query does not exist.
Pokhara: Fuel Stations : Metadata updated!
Pokhara: Government Offices : Metadata updated!
pokhara: non-governmental organizations : Failed to update
Exception: Layer matching query does not exist.
Pokhara: Ward Offices : Metadata updated!
pokhara: security services : Failed to update
Exception: Layer matching query does not exist.
Pokhara: Hospitals : Metadata updated!
Pokhara: Helath Posts : Metadata updated!
Pokhara: Pharmacies : Metadata updated!
Pokhara: Clinics : Metadata updated!
Pokhara: Dentists : Metadata updated!
Pokhara: Veterinaries : Metadata updated!
Pokhara: Schools : Metadata updated!
Pokhara: Private Schools : Metadata updated!
Pokhara: Government Schools : Metadata updated!
Pokhara: Kindergartens : Metadata updated!
Pokhara: Wards : Metadata updated!
Pokhara: Media : Metadata updated!
kalxas commented 5 years ago

We completed a cleanup of the database, things should be fine now

kalxas commented 5 years ago

These are the layers that did not have metadata:

sophialinn commented 5 years ago

Missing data and metadata for Pokhara can be found in this folder:

https://drive.google.com/open?id=1W-QLUR7D33wU7NUeeMwVih5EkY-ThN2p

kalxas commented 5 years ago

Metadata spreadsheet has a comment about pok_highways.shp. Should we ignore that line?

sophialinn commented 5 years ago

Yes, ignore/delete the pok_highways.shp line in the metadata

kalxas commented 5 years ago 
Finished processing 9 layers in 528.0 seconds.

9 Created layers
0 Updated layers
0 Skipped layers
0 Failed layers
58.666667 seconds per layer
kalxas commented 5 years ago 
Pokhara: Hotels : Metadata updated!
Pokhara: Non-Governmental Organizations : Metadata updated!
Pokhara: Places of Worship : Metadata updated!
Pokhara: Primary Roads : Metadata updated!
Pokhara: Residential Roads : Metadata updated!
Pokhara: Secondary Roads : Metadata updated!
Pokhara: Tertiary Roads : Metadata updated!
Pokhara: Tourist Attractions : Metadata updated!
kalxas commented 5 years ago

ready for review

sophialinn commented 5 years ago

waiting for geonode to be restored (certificate issue) and will then review

kalxas commented 5 years ago

GeoNode is up, you just need to add an exception and you can see it working

kalxas commented 5 years ago

Pokhara Highways metadata missing from both latest spreadsheets

https://secondarycities.geonode.state.gov/layers/geonode:pok_highways

sophialinn commented 5 years ago

Message from Gaurav (Pokhara partner):

_The pok_highways was renamed to poktrunkroad. And this file is redundant.

sophialinn commented 5 years ago

...but now I don't see _poktrunkroad anywhere. I'm going to follow up, but until then, go ahead and delete _pokhighways

kalxas commented 5 years ago

ok thanks