Data issues with My Neighborhood Lookup tool

[duffy-james]

We continue to see outdated information in the My Neighborhood Lookup tool. This could be because:

• we have duplicate records, or
• because the underlying data which is sent from Analytics is still wrong.

@davidrkupton reached out to Andrew Shirshac with follow-up questions from our side:

Referring to Charles Sheils email on MNL for 1 Akron St where there is a mix of info for the representatives, this is the information that we have stored for that SAM ID 161394:

{ "geom_2249": "0101000020C9080000492C4533137027412DAA0B0F1B764641", "city_council_district": "7", "city_council_councilor": "Tania Fernandes Anderson", "city_council_image": "https://www.boston.gov/sites/default/files/styles/person_photo_profile_large_360x360_/public/img/lib", "city_council_webpage": "https://bit.ly/3qXEEY0", "ons_liaison_ons": "13", "ons_liaison_name": "Jessica Thomas", "ons_liaison_pic_url": "https://services.arcgis.com/sFnw0xNflSi8J0uh/arcgis/rest/services/ONS_Coordinators/FeatureServer/0/1011/attachments/2201", "ons_liaison_neighborhood": "Roxbury", "ons_liaison_webpage": "https://www.boston.gov/departments/neighborhood-services/jessica-thomas", "public_libraries_branch": "Dudley", "public_libraries_address": "149 Dudley St", "public_libraries_district": "ROXBURY", "public_libraries_zipcode": "02119", "community_centers_name": "BCYF Shelburne", "community_centers_address": "2730 Washington St. Roxbury 02119", "bcyf_pool_centers_name": "BCYF Madison Park", "bcyf_pool_centers_address": "55 Malcolm X Blvd. Roxbury 02119", "fire_dept_name": "Engine CO. 14, 4", "fire_dept_address": "174 Dudley St", "fire_dept_neighborhood": "Roxbury", "parks_name": "St James Street Park", "parks_ownership": "City of Boston", "parks_district": "Roxbury", "parks_type": "Parks, Playgrounds \u0026 Athletic Fields", "police_dept_police_station": "District B-2 Police Station", "police_dept_address": "2400 Washington St", "police_dept_neighborhood": "Roxbury", "police_dept_zip": "02119", "police_district": "B2", "ward_name": "12", "precincts_name": "01", "early_voting_location": "BCYF Shelburne Gymnasium", "early_voting_address": "2730 Washington Street, Roxbury, MA 02119", "early_voting_neighborhood": "Roxbury", "early_voting_date_and_time": "Saturday, October 23: 11am-7pm;\nSunday, October 24: 11am-7pm", "snow_parking_lots_name": "Municipal Lot #028", "snow_parking_lots_address": "44 Warren St / Ziegler St", "snow_parking_lots_fee": "No Charge", "snow_routes_name": "Washington St", "snow_routes_responsibility": "City", "tot_sprays_address": "45 Lambert Avenue", "tot_sprays_name": "Lambert Avenue Playground" }

David looked back at the website import records and saw a full import 2022-03-02 and an incremental import 2022-02-09. The data received via the imports from Civis gets deleted after it is ingested, so he could not verify if it did in fact overwrite existing information. For each SAM ID, the whole data set is represented as a json string, and stored as a json string, so either the whole record is updated or none of it is.

Asks for Analytics:

• We need them to check the information they have stored for SAM ID 161394 and compare to the record in this ticket. The field for this error is probably ons_liaison_name.
• David needs access to the Civis backend to dig into the data. He wants to be able to view and run (but not alter) the nightly and weekly/monthly job that pushes to the website.
• David needs a block of the data that is sent through to the website (a few hundred records or so) to make some test imports in a dev area to save it and use for future testing.

[duffy-james]

Closing this out; @davidrkupton has worked through these issues. The work is accounted for in Jira.