Mechanism to synchronize with external data sources

codeforboston / pantry_pickup

Combining city data with a list of specific needs from food pantries will allow citizens to most effectively make useful and needed donations assisted by the Pantry Pick-Up App.

http://www.pantrypickup.org

21 stars 35 forks source link

Mechanism to synchronize with external data sources #14

Open carpeliam opened 11 years ago

carpeliam commented 11 years ago

As external data sources are updated, we need to stay in sync. Create a service that will respond to changes and update our database as necessary, without duplicating results or losing data quality.

eucalyptustree commented 11 years ago

Re: Duplicate rows, these may be tricky to detect programmatically, and may have to be caught manually. Examples:

From the CoFBoston List: St Anthony Shrine/Franciscan Food Center From GBFB Member Agency: Saint Anthony Shrine Franciscan Food Center

Etc.

I'm working on the data source (in /files/geocode-inprogress.xlsx) and have marked the duplicates there.