Wipe and replace GOGA data

chadlawlis commented 8 years ago

[x] Trails
[x] Roads
[x] Building footprints
[x] Points of interest
[x] Fortifications
[x] Parking lots
[x] Draw in Presidio Golf Course

Data seed directory HERE.

Trails = goga_trails_20160301.shp (use "TrailName" for name and "AltName" for classification/approved uses).

Roads = GOGA_roads_chad_v2.zip

Buildings = GOGA_buildings_and_pres_for_chad.zip (Address_points_for_Chad.shp not useful for Places).

Points of interest = GOGA_POI_for_chad.zip

Fortifications = GOGA_fortifications.zip

Parking = GOGA_parking_for_chad.zip

Presidio golf course = golf course detail.zip (not used)

Pre-seed data to be stored HERE.

Processed seed data (what is uploaded) to be stored HERE.

chadlawlis commented 8 years ago

Roads coming soon, once classified to fit NPS Road Standards.

chadlawlis commented 8 years ago

Reminder: add these to seed/data tracking spreadsheets once complete.

chadlawlis commented 8 years ago

Roads and building footprints have been added to the directory on Drive above.

Parking lot areas will take some time, as this data currently does not exist. Craig is working with the park on POIs, so expect this in the next week or two.

chadlawlis commented 8 years ago

Trails removed via changeset 8069.

chadlawlis commented 8 years ago

Trails seed has been processed and uploaded via changeset 8071.

Notes:

Numerical field value meanings: 0 and 2 = null or no 1 = yes

Translations:

"TrailName" = name "TrailClass" = tracktype "TrailSurfa" = surface "Hike" = foot "PackOrSadd" = horse "Bike" = bicycle "Motorcycle" = motorcycle (all values are 0 or 2, which means null or no - field not used) "ATV" = atv (all values are 0 or 2, which means null or no - field not used)

"TrailSurfa" field value translations: Wood = wood (unless "comments" = Boardwalk or boardwalk = boardwalk) Concrete = concrete Gravel = gravel Asphalt = asphalt (unless "comments" = Paved or "flagcommen" = Paved Road = paved) "comments" = sand = sand "comments" ilike 'dirt%' = dirt

"comments" and "flagcommen" field value translations: "comments" = Tunnel or "flagcommen" = tunnel = tunnel=yes "comments" = bridge or "flagcommen" = bridge = bridge=yes "comments" = stair or "comments" ilike '%stair%' or "flagcommen" = Stair = highway=steps "flagcommen" = Crosswalk = crossing=yes otherwise, highway=path for all

Topologies were enforced and line segments combined as appropriate. Given this data may be overwritten via Sync soon topologies were not enforced across all trails, only as needed to combine like segments (to create continual trails, as appropriate).

Final .osm file seeded is here.

chadlawlis commented 8 years ago

Roads removed via changeset 8093.

Filters (filter out trails, show only ways with highway=*):

road_filter

I checked for any remaining orphan nodes, of which there were none (all tagged nodes along a way should have been removed via #626). If orphan nodes reappear once this goes live to Places, there is a translation issue or some other bug between JOSM and Places.

chadlawlis commented 8 years ago

Roads seed has been processed and uploaded via changeset 8094.

Notes:

"roadclass" field (suggestions from call with Craig):

"Primary" indicates a highway or major throughway (Craig heads-up-digitized most of these, using 2015 imagery) - typically add as "Primary Road" (highway=primary)
"Private" indicates a private park maintenance road - add as "Access Road" (highway=service) with access=private
"Local" indicates a city street technically outside the park / not park managed - add as "Minor Road" (highway=unclassified)
"Service" indicates a minor road inside the park - add as "Minor Road" (highway=unclassified)
- 'HWY 101' is classified as "Service", should be classified as "Primary" - mistake on Craig's end, identified by him

Translations:

"roadname" field = name, unless:

"name" = 'Doyle Drive' where roadaltnam = 'DOYLE DR';
"name" = 'Golden Gate Bridge' where roadaltnam = 'GOLDEN GATE BRIDGE';

"roadlanes" field = lanes (1 = 1) "roadsurfac" = surface (Asphalt = asphalt)

"roadclass":

highway=road where roadclass is null
highway=primary where roadclass = Primary and name != Highway 101
highway=motorway where name = Highway 101 or name = Golden Gate Bridge or name = Doyle Drive
highway=motorway_link where name = Highway 101 Ramp
highway=unclassified where roadclass=Service and name != Highway 101 and name != Golden Gate Bridge and name != Doyle Drive
- (these were misclassified as "Service")
highway=unclassified where roadclass=Local
highway=service, access=private where roadclass=Private

bridge=yes where name = Golden Gate Bridge

Topologies were enforced and line segments combined as appropriate. Given this data may be overwritten via Sync soon topologies were not enforced across all roads or between roads/trails, only as needed to combine like segments (to create continual roads, as appropriate).

Final .osm file seeded is here.

chadlawlis commented 8 years ago

Building footprints removed via changeset 8182.

Filters: building_filter

I checked for any remaining orphan nodes, of which there were none.

chadlawlis commented 8 years ago

Building footprints seed has been processed and uploaded via changeset 8183.

Notes:

Only building footprints for GOGA, PRSF, FOPO, ALCA, MUWO, and SAFR were seeded. Dataset also included EUON, JOMU, PORE, and RORI (which will be added via Sync, not to worry about for now).

Translations:

The only field used was unit_code, which translates to nps:unit_code. Value "PRES" was converted to the proper unit code "PRSF", otherwise "Yes" and "No" were translated to the appropriate unit code based on location within the updated boundaries.

common_nam was not used, as this is oriented more towards a park maintenance audience (not for public use).

Otherwise the building=yes tag was added for all.

Final .osm file seeded is here.

chadlawlis commented 8 years ago

Points of interest removed via changeset 8186.

Filters: poi_filter

chadlawlis commented 8 years ago

Fortifications removed via changeset 8188.

Filters: fortification_filter

chadlawlis commented 8 years ago

Points of interest seed has been processed and uploaded via changeset 8189.

Notes:

Only POIs for GOGA, PRSF, FOPO, ALCA, MUWO, and SAFR were seeded. Dataset also included JOMU and PORE (which will be added via Sync, not to worry about for now).

The following "poitype" values do not correspond to a preset in Places, and therefore were not included:

"Admin"
"Air Nav Aid"
"Cable Car"
"Lawn Area"
"Park Partner"
"Road"
"Sewer Outflow"

Translations:

"poiname" = name

"poitype" translations:

-- classify based directly on "poitype"
UPDATE goga_poi_processed SET aeroway = 'aerodrome' WHERE poitype = 'Airport';
UPDATE goga_poi_processed SET leisure = 'pitch' WHERE poitype = 'Ballfield';
UPDATE goga_poi_processed SET historic = 'archaeological_site', site_type = 'fortification' WHERE poitype = 'Battery';
UPDATE goga_poi_processed SET "natural" = 'beach' WHERE poitype = 'Beach';
UPDATE goga_poi_processed SET amenity = 'bicycle_parking', bicycle_parking = 'rack' WHERE poitype = 'Bike Rack';
UPDATE goga_poi_processed SET man_made = 'pier', mooring = 'yes' WHERE poitype = 'Boat';
UPDATE goga_poi_processed SET building = 'yes' WHERE poitype = 'Building';
UPDATE goga_poi_processed SET highway = 'bus_stop' WHERE poitype = 'Bus Stop';
UPDATE goga_poi_processed SET building = 'cabin' WHERE poitype = 'Cabin';
UPDATE goga_poi_processed SET tourism = 'camp_site' WHERE poitype = 'Campground';
UPDATE goga_poi_processed SET landuse = 'cemetery' WHERE poitype = 'Cemetery';
UPDATE goga_poi_processed SET building = 'chapel' WHERE poitype = 'Chapel';
UPDATE goga_poi_processed SET amenity = 'drinking_water' WHERE poitype = 'Drinking Water';
UPDATE goga_poi_processed SET building = 'yes', amenity = 'education_centre' WHERE poitype = 'Education Center';
UPDATE goga_poi_processed SET barrier = 'entrance' WHERE poitype = 'Entrance';
UPDATE goga_poi_processed SET place = 'farm' WHERE poitype = 'Farm';
UPDATE goga_poi_processed SET barrier = 'fence' WHERE poitype = 'Fence';
UPDATE goga_poi_processed SET leisure = 'fishing' WHERE poitype = 'Fishing';
UPDATE goga_poi_processed SET amenity = 'food_court' WHERE poitype = 'Food Service';
UPDATE goga_poi_processed SET amenity = 'parking' WHERE poitype = 'Future Parking';
UPDATE goga_poi_processed SET leisure = 'garden' WHERE poitype = 'Garden';
UPDATE goga_poi_processed SET barrier = 'gate' WHERE poitype = 'Gate';
UPDATE goga_poi_processed SET leisure = 'golf_course' WHERE poitype = 'Golf Course';
UPDATE goga_poi_processed SET building = 'office', office = 'government', "function" = 'headquarters' WHERE poitype = 'Headquarters';
UPDATE goga_poi_processed SET amenity = 'hospital' WHERE poitype = 'Hospital';
UPDATE goga_poi_processed SET "natural" = 'water', water = 'lake' WHERE poitype = 'Lake';
UPDATE goga_poi_processed SET aeroway = 'aerodrome', aerodrome = 'airstrip', surface = 'ground' WHERE poitype = 'Landing Zone';
UPDATE goga_poi_processed SET man_made = 'lighthouse' WHERE poitype = 'Lighthouse';
UPDATE goga_poi_processed SET tourism = 'hotel' WHERE poitype = 'Lodging';
UPDATE goga_poi_processed SET tourism = 'museum' WHERE poitype = 'Museum';
UPDATE goga_poi_processed SET office = 'government' WHERE poitype = 'NPS Office';
UPDATE goga_poi_processed SET leisure = 'park' WHERE poitype = 'Park';
UPDATE goga_poi_processed SET leisure = 'park' WHERE poitype = 'Park Area';
UPDATE goga_poi_processed SET amenity = 'parking' WHERE poitype = 'Parking Lot';
UPDATE goga_poi_processed SET "natural" = 'peak' WHERE poitype = 'Peak';
UPDATE goga_poi_processed SET tourism = 'picnic_site' WHERE poitype = 'Picnic';
UPDATE goga_poi_processed SET tourism = 'picnic_site' WHERE poitype = 'Picnic Area';
UPDATE goga_poi_processed SET man_made = 'pier', mooring = 'yes' WHERE poitype = 'Pier';
UPDATE goga_poi_processed SET place = 'locality' WHERE poitype = 'Place';
UPDATE goga_poi_processed SET leisure = 'playground' WHERE poitype = 'Playground';
UPDATE goga_poi_processed SET tourism = 'yes' WHERE poitype = 'Point of Interest';
UPDATE goga_poi_processed SET amenity = 'post_office' WHERE poitype = 'Post Office';
UPDATE goga_poi_processed SET amenity = 'toilets' WHERE poitype = 'Restroom';
UPDATE goga_poi_processed SET building = 'retail' WHERE poitype = 'Retail';
UPDATE goga_poi_processed SET building = 'terrace' WHERE poitype = 'Row House';
UPDATE goga_poi_processed SET historic = 'ruins' WHERE poitype = 'Ruins';
UPDATE goga_poi_processed SET sport = 'sailing' WHERE poitype = 'Sailing';
UPDATE goga_poi_processed SET building = 'school' WHERE poitype = 'School';
UPDATE goga_poi_processed SET building = 'school' WHERE poitype = 'School Building';
UPDATE goga_poi_processed SET tourism = 'artwork', artwork_type = 'statue' WHERE poitype = 'Sculpture';
UPDATE goga_poi_processed SET tourism = 'yes' WHERE poitype = 'Site of Interest';
UPDATE goga_poi_processed SET building = 'stable' WHERE poitype = 'Stable';
UPDATE goga_poi_processed SET highway = 'steps' WHERE poitype = 'Stairs';
UPDATE goga_poi_processed SET shop = 'general' WHERE poitype = 'Store';
UPDATE goga_poi_processed SET waterway = 'stream' WHERE poitype = 'Stream';
UPDATE goga_poi_processed SET sport = 'swimming' WHERE poitype = 'Swim Club';
UPDATE goga_poi_processed SET leisure = 'pitch' WHERE poitype = 'Tennis Court';
UPDATE goga_poi_processed SET highway = 'path' WHERE poitype = 'Trail';
UPDATE goga_poi_processed SET highway = 'trailhead' WHERE poitype = 'Trailhead';
UPDATE goga_poi_processed SET tunnel = 'yes' WHERE poitype = 'Tunnel';
UPDATE goga_poi_processed SET "natural" = 'valley' WHERE poitype = 'Valley';
UPDATE goga_poi_processed SET tourism = 'viewpoint' WHERE poitype = 'Viewpoint';
UPDATE goga_poi_processed SET tourism = 'information', information = 'office' WHERE poitype = 'Visitor Center';
UPDATE goga_poi_processed SET building = 'warehouse' WHERE poitype = 'Warehouse';
UPDATE goga_poi_processed SET amenity = 'boat_wash', "type" = 'zebra_mussel' WHERE poitype = 'Zebra Mussel Decontamination Station';

-- classify "poitype" = "Access" based on "poiname"
UPDATE goga_poi_processed SET barrier = 'gate' WHERE poitype = 'Access' AND poiname ilike '% gate%';
UPDATE goga_poi_processed SET bridge = 'yes' WHERE poitype = 'Access' AND poiname ilike '%footbridge%';
UPDATE goga_poi_processed SET barrier = 'entrance' WHERE poitype = 'Access' AND poiname ilike '%entrance%';

-- classify remaining points without a set "poitype"
UPDATE goga_poi_processed SET building = 'apartments' WHERE poitype IS NULL AND poiname ILIKE '%apartment%';
UPDATE goga_poi_processed SET barrier = 'gate' WHERE poitype IS NULL AND poiname ILIKE '% gate';
UPDATE goga_poi_processed SET historic = 'archaeological_site', site_type = 'fortification' WHERE poitype IS NULL AND poiname ILIKE '%battery%';
UPDATE goga_poi_processed SET building = 'terrace' WHERE poitype IS NULL AND poiname ILIKE '%townhome%';
UPDATE goga_poi_processed SET place = 'farm' WHERE poitype IS NULL AND poiname ILIKE '%farm%';
UPDATE goga_poi_processed SET leisure = 'garden' WHERE poitype IS NULL AND poiname ILIKE '%garden%';
UPDATE goga_poi_processed SET building = 'chapel' WHERE poitype IS NULL AND poiname ILIKE '%chapel%';
UPDATE goga_poi_processed SET leisure = 'pitch' WHERE poitype IS NULL AND poiname ILIKE '%tennis%';
UPDATE goga_poi_processed SET shop = 'general' WHERE poitype IS NULL AND poiname ILIKE '% store%';
UPDATE goga_poi_processed SET place = 'locality' WHERE poitype IS NULL AND poiname ILIKE '%neighborhood%';
UPDATE goga_poi_processed SET highway = 'path' WHERE poitype IS NULL AND poiname ILIKE '%trail%';
UPDATE goga_poi_processed SET "natural" = 'water', water = 'lake' WHERE poitype IS NULL AND poiname ILIKE '%lake%';
UPDATE goga_poi_processed SET "natural" = 'grassland', grassland_type = 'plain' WHERE poitype IS NULL AND poiname ILIKE '%meadow%';
UPDATE goga_poi_processed SET leisure = 'park' WHERE poitype IS NULL AND poiname ILIKE '%state park%';
UPDATE goga_poi_processed SET tourism = 'museum' WHERE poitype IS NULL AND poiname ILIKE '%army museum%';
UPDATE goga_poi_processed SET tourism = 'artwork', artwork_type = 'statue' WHERE poitype IS NULL AND poiname ILIKE '%statue%';
UPDATE goga_poi_processed SET building = 'office' WHERE poitype IS NULL AND (poiname ILIKE '%office%' OR poiname ILIKE '%headquarters%');
UPDATE goga_poi_processed SET amenity = 'cinema' WHERE poitype IS NULL AND (poiname ILIKE '%theater%' OR poiname ILIKE '%film%');
UPDATE goga_poi_processed SET sport = 'swimming' WHERE poitype IS NULL AND poiname ILIKE '%pool%';
UPDATE goga_poi_processed SET "natural" = 'water', water = 'reservoir', landuse = 'reservoir' WHERE poitype IS NULL AND poiname ILIKE '%reservoir%';
UPDATE goga_poi_processed SET highway = 'bus_stop' WHERE poitype IS NULL AND poiname ILIKE '%transit%';
UPDATE goga_poi_processed SET historic = 'memorial' WHERE poitype IS NULL AND poiname ILIKE '%memorial%';

-- remove records with no translatable information
DELETE FROM goga_poi_processed WHERE poiname IS NULL AND poitype IS NULL;
DELETE FROM goga_poi_processed WHERE poiname = 'c';

-- remove remaining points without any tags
DELETE FROM goga_poi_processed WHERE aeroway IS NULL AND aerodrome IS NULL AND surface IS NULL AND amenity IS NULL AND bicycle_parking IS NULL AND "type" IS NULL AND barrier IS NULL AND bridge IS NULL AND building IS NULL AND office IS NULL AND "function" IS NULL AND highway IS NULL AND historic IS NULL AND site_type IS NULL AND landuse IS NULL AND leisure IS NULL AND man_made IS NULL AND mooring IS NULL AND "natural" IS NULL AND grassland_type IS NULL AND water IS NULL AND place IS NULL AND shop IS NULL AND sport IS NULL AND tourism IS NULL AND artwork_type IS NULL AND information IS NULL AND tunnel IS NULL AND waterway is null;

Final .osm file seeded is here.

chadlawlis commented 8 years ago

Fortification seed has been processed and uploaded via changeset 8848.

Fortifications were removed where they overlapped buildings, per guidance from Will @ GOGA:

I have reviewed these and determined that where there are both fortification and structure polygons, you should use the structure polygon, as it is more accurate.

Some fortifications overlap other features, which will have to be remedied on Craig's end before consumption by Places.

Translations:

"description" = name

chadlawlis commented 8 years ago

The Presidio Golf Course was drawn in manually in Editor via changeset 8849.

chadlawlis commented 8 years ago

Parking seed has been processed and uploaded via changeset 8850 (ALCA unit codes updated via following changeset 8851).

Notes:

Only parking for FOPO, GOGA, MUWO, PRSF, SAFR. Dataset also included EUON, JOMU, PORE.

Translations:

"parkingname" = name

"parkingsurface" = surface

"Asphalt" = asphalt
"Concrete" = concrete
"Native or Dirt" = dirt

Parking already in Places that did not overlap new data was retained, per Craig's instruction:

You might keep some parking in the center of the Presidio that you created. I wasn't able to digitize that.

Final .osm file seeded is here.

chadlawlis commented 8 years ago

Should be all set here for now.

Craig to follow with some POI updates, which I'll address once they come through.

nationalparkservice / places-data

Wipe and replace GOGA data #612