streetlives / yourpeer.nyc

The open source repository behind the yourpeer.nyc web application
https://yourpeer.nyc
MIT License
0 stars 0 forks source link

Diagnose and Fix database duplicate service ids #195

Open adambard1 opened 2 weeks ago

adambard1 commented 2 weeks ago

From today's export, the following services are duplicate service-ids with seemingly identical data.

<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:x="urn:schemas-microsoft-com:office:excel" xmlns="http://www.w3.org/TR/REC-html40">

service_id | org | location | services | sstt_link | gogetta_link | yourpeer_link | website | phones | address | city | zipcode | visible_on_gogetta | child_taxonomy | parent_taxonomy | age_min | age_max | all_ages | population_served -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- 01ee6c13-d2a7-4702-b0d3-397380731b0f | Jewish Board of Family and Children’s Services |   | Family, Teen, and Children's Services | https://www.gogetta.nyc/team/location/37d368fb-6bb3-4303-9af6-0de6ebad29ea | https://www.gogetta.nyc/find/location/37d368fb-6bb3-4303-9af6-0de6ebad29ea | https://yourpeer.nyc/locations/jewish-board-of-family-and-childrens-services-midtown | jewishboard.org | 212.582.9100, 844.663.2255 | 463 7th Ave | New York | 10020 | V |   | Health |   |   | true |   01ee6c13-d2a7-4702-b0d3-397380731b0f | Jewish Board of Family and Children’s Services |   | Family, Teen, and Children's Services | https://www.gogetta.nyc/team/location/37d368fb-6bb3-4303-9af6-0de6ebad29ea | https://www.gogetta.nyc/find/location/37d368fb-6bb3-4303-9af6-0de6ebad29ea | https://yourpeer.nyc/locations/jewish-board-of-family-and-childrens-services-midtown | jewishboard.org | 212.582.9100, 844.663.2255 | 463 7th Ave | New York | 10020 | V |   | Health |   |   | true |   874721f1-b00b-44b1-bd24-09ebf6c736bb | Inwood Community Services (ICS) |   | Youth Employment Programs | https://www.gogetta.nyc/team/location/3b14d00b-eaea-4be6-9c49-95053ec6dad0 | https://www.gogetta.nyc/find/location/3b14d00b-eaea-4be6-9c49-95053ec6dad0 | https://yourpeer.nyc/locations/inwood-community-services-ics-inwood | inwoodcommunityservices.org | 212.942.0043 | 651 Academy St | New York | 10034 | V |   | Other service | 14 | 24 | false |   874721f1-b00b-44b1-bd24-09ebf6c736bb | Inwood Community Services (ICS) |   | Youth Employment Programs | https://www.gogetta.nyc/team/location/3b14d00b-eaea-4be6-9c49-95053ec6dad0 | https://www.gogetta.nyc/find/location/3b14d00b-eaea-4be6-9c49-95053ec6dad0 | https://yourpeer.nyc/locations/inwood-community-services-ics-inwood | inwoodcommunityservices.org | 212.942.0043 | 651 Academy St | New York | 10034 | V |   | Other service | 14 | 24 | false |   ce1cc980-57e3-4620-99b4-c5fa063143aa | El Centro del Inmigrante |   | Food Pantry | https://www.gogetta.nyc/team/location/b633d75f-0c03-40b3-869f-3d851e737692 | https://www.gogetta.nyc/find/location/b633d75f-0c03-40b3-869f-3d851e737692 | https://yourpeer.nyc/locations/el-centro-del-inmigrante-port-richmond | elcentronyc.org | 347.825.2086 | 260 Port Richmond Ave | Staten Island | 10302 | V | Food Pantry | Food | 18 |   | false |   ce1cc980-57e3-4620-99b4-c5fa063143aa | El Centro del Inmigrante |   | Food Pantry | https://www.gogetta.nyc/team/location/b633d75f-0c03-40b3-869f-3d851e737692 | https://www.gogetta.nyc/find/location/b633d75f-0c03-40b3-869f-3d851e737692 | https://yourpeer.nyc/locations/el-centro-del-inmigrante-port-richmond | elcentronyc.org | 347.825.2086 | 260 Port Richmond Ave | Staten Island | 10302 | V | Food Pantry | Food | 18 |   | false |  

adambard1 commented 2 weeks ago

There are three other duplicate service id's but with different Age data. In each case, the top row is the correct info and the lower row is the wrong info.

<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:x="urn:schemas-microsoft-com:office:excel" xmlns="http://www.w3.org/TR/REC-html40">

service_id | org | location | services | sstt_link | gogetta_link | yourpeer_link | website | phones | address | city | zipcode | visible_on_gogetta | child_taxonomy | parent_taxonomy | age_min | age_max | all_ages | population_served -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- 188ec1ee-4334-4877-80a8-1dca27cfc1bf | Missionary Church of Christ, Inc. |   | Food Pantry | https://www.gogetta.nyc/team/location/13ee9e1d-5eda-4629-a872-4c5b1677d759 | https://www.gogetta.nyc/find/location/13ee9e1d-5eda-4629-a872-4c5b1677d759 | https://yourpeer.nyc/locations/missionary-church-of-christ-inc-melrose | https://www.iglesiacristomisionera.org/ | 718.588.4545, 917.488.8413 | 937 Teller Ave | The Bronx | 10451 | V | Food Pantry | Food |   |   | true |   188ec1ee-4334-4877-80a8-1dca27cfc1bf | Missionary Church of Christ, Inc. |   | Food Pantry | https://www.gogetta.nyc/team/location/13ee9e1d-5eda-4629-a872-4c5b1677d759 | https://www.gogetta.nyc/find/location/13ee9e1d-5eda-4629-a872-4c5b1677d759 | https://yourpeer.nyc/locations/missionary-church-of-christ-inc-melrose | https://www.iglesiacristomisionera.org/ | 718.588.4545, 917.488.8413 | 937 Teller Ave | The Bronx | 10451 | V | Food Pantry | Food | 3 | 4 | false |   5c9749df-b1d0-4b7f-a72c-f4304a058213 | Acacia Network | El Regreso Foundation Inc | Chemical Dependency Outpatient Program | https://www.gogetta.nyc/team/location/fe0f768d-295d-4f6e-8766-ffc12e73943d | https://www.gogetta.nyc/find/location/fe0f768d-295d-4f6e-8766-ffc12e73943d | https://yourpeer.nyc/locations/acacia-network-williamsburg | acacianetwork.org | 718.782.6802 | 141-143 S 3rd St | Brooklyn | 11211 | V |   | Health | 14 |   | false |   5c9749df-b1d0-4b7f-a72c-f4304a058213 | Acacia Network | El Regreso Foundation Inc | Chemical Dependency Outpatient Program | https://www.gogetta.nyc/team/location/fe0f768d-295d-4f6e-8766-ffc12e73943d | https://www.gogetta.nyc/find/location/fe0f768d-295d-4f6e-8766-ffc12e73943d | https://yourpeer.nyc/locations/acacia-network-williamsburg | acacianetwork.org | 718.782.6802 | 141-143 S 3rd St | Brooklyn | 11211 | V |   | Health | 18 |   | false |   6854248d-7124-4962-b930-4f6e2f812456 | Staten Island Mental Health Society | Dr Kenneth Popler Children's Center | WIC Program | https://www.gogetta.nyc/team/location/6d3720c8-fd2e-47f0-860c-b5891f695a28 | https://www.gogetta.nyc/find/location/6d3720c8-fd2e-47f0-860c-b5891f695a28 | https://yourpeer.nyc/locations/staten-island-mental-health-society-st-george | rumcsi.org/services/behavioral-health/staten-island-mental-health-society/outpatient-children-family | 718.720.6727 | 444 St Marks Pl | Staten Island | 10301 | V |   | Food |   | 5 | false |   6854248d-7124-4962-b930-4f6e2f812456 | Staten Island Mental Health Society | Dr Kenneth Popler Children's Center | WIC Program | https://www.gogetta.nyc/team/location/6d3720c8-fd2e-47f0-860c-b5891f695a28 | https://www.gogetta.nyc/find/location/6d3720c8-fd2e-47f0-860c-b5891f695a28 | https://yourpeer.nyc/locations/staten-island-mental-health-society-st-george | rumcsi.org/services/behavioral-health/staten-island-mental-health-society/outpatient-children-family | 718.720.6727 | 444 St Marks Pl | Staten Island | 10301 | V |   | Food |   | 4 | false |  

adambard1 commented 2 weeks ago

@jbeard4 doobneek believes the duplicated happened cos Specialists including them got into the habit of duplicating rows on the Ages sheet in advance of adding new services, but sometimes forgot to change all the data in the cells, including the service _id.

However, 01ee6c13-d2a7-4702-b0d3-397380731b0f and 874721f1-b00b-44b1-bd24-09ebf6c736bb are not duplicated on the Ages sheet (I can't tell if this is cos doobneek has now corrected it).

It isn't clear how or when the duplicates have been created.