Worldmap: Format/Add/Test Curated Target Layers

[raprasad]

Curated target layers to add for BARI

Steps for each layer:

1. Add to WorldMap
2. Specify as JoinTarget
3. Test via GeoConnect interface
   1. correct column format, incorrect column format
   2. int -> char; char -> int; double -> int; int -> double
   3. update code as needed

Layer list

Full checklist at: google doc

For administrative layers:

• Data: Geographical Infrastructure v. 2015 Dataverse
• Docs: Documentation for the 2015 Geographical Infrastructure

Boston for now, but we want Massachusetts (or National) data

• [x] Census Tracts 2010, Boston

  • [x] test depends on #3485

• [x] Census Block Groups 2010, Boston

• [x] Census Blocks 2010, Boston

• [x] US Zip Codes 2014, Boston

• Note: The following admin. layers assume the fix of #3484 done 11/22

Boston specific data

• [x] BRA Neighborhood Statistical Areas 2015, Boston
• [x] BRA Planning Districts 2015, Boston
• [x] City Council Districts 2014, Boston
• [x] Election Precincts 2015, Boston
• [x] Election Wards 2015, Boston
• [x] Fire Districts 2015, Boston
  • [x] Layer loaded as target
  • [x] CHECK: Number are discontinuous: 1, 3, 4, 6, 7, 8, 9, 11, 12. Correct?
    • ok, same as dataverse archived file
• [x] ISD Neighborhoods 2015, Boston
• [x] Police Districts 2015, Boston
• [x] PWD Districts 2015, Boston
• [x] Addresses 2015, Boston
• [x] Parcels 2015, Boston moved to #3493
  • 11/22 - keeps hanging on upload
• [x] Roads 2015, Boston
• [x] Intersections 2015, Boston
  • [x] City intersections
  • [x] Census intersections

[raprasad]

Election Precincts note:

• In original format, precinct id is a "double" in WorldMap, not an "int"--although looks like an int with .00000 added
  • Currently double and int not joining.
  • Options:
  • [ ] Try reformat of orig. file? (Yes, easy 1st option)
  • [ ] Detect WorldMap "double" and do pandas convert (If same issue in other files)
  • Worked OK. Option
  • [ ] When target layer selected in Geoconnect, show user message about expected type. Expected type (numeric or character) already in geoconnect data from WM.
  • new ticket #3494
  • Better? check with Ben: add WorldMap field where admin can add description.

[raprasad]

bug on dev side (leave for now):

• [x] When manually changing tabular file via admin, clear JSON column names attribuate
  • moved to ticket #3052

[raprasad]

For fire districts (and possibly BPA planning districts + election wards) there is truncated data. e.g. when downloading the .xls:

check with Ben re: DATA TRUNCATED MULTIPOLYGON

• May be just message for Excel download. All data seems to be in postgis

DATA TRUNCATED MULTIPOLYGON (((746870.6151123643 2935873.384744346, 746973.7536856085 2935786.328816101, 747212.6042577773 2935584.6510698497, 747286.2008953542 29355
(etc, etc. for many, many lines)

[raprasad]

Note: updating 3 layers to use versions in Dataverse 2015 BARI Regional Geographies: https://dataverse.harvard.edu/dataset.xhtml?persistentId=doi:10.7910/DVN/PJ3JK2

[raprasad]

census layout (e.g. GEOID10): https://www.census.gov/geo/maps-data/data/tract_rel_layout.html

[raprasad]

block groups (bg_id_10 in BARI file) are 12-digits FIPS codes that may have leading zeros:

(image source: https://www.policymap.com/blog/2012/08/tips-on-fips-a-quick-guide-to-geographic-place-codes-part-iii/)

[raprasad]

Boston zip codes in. Correct mapping--including error. (Typo in error message covered in another ticket)

[raprasad]

• No actual code to review. Discussed with @kcondon and moving to QA

• NOTE: QA Dependent on configuration/installation of Dev Server which has a target date of 2/9

[kcondon]

OK tested various available layers and they worked. Closing.