rfortherestofus / api-food-asset-map

5 stars 1 forks source link

Import data on grocery stores #11

Closed dgkeyes closed 3 years ago

dgkeyes commented 3 years ago

The ideal here would be to use Google Places API but their terms don't allow us to do so. Can we use Open Street Map or something else to get this data?

Also, how can we make sure we're bringing in smaller places (corner markets, convenience stores, etc) as well as large chain grocery stores?

katiejolly commented 3 years ago

image

This is what the query for shop:supermarket returns from OSM. I'll look to see what other tags might be relevant as well.

katiejolly commented 3 years ago

Convenience stores: image

dgkeyes commented 3 years ago

Wow, awesome! Question for you: I see you use both the city + county of San Francisco. Are they different? Why use both? I'm sure there's a good reason, but I don't know what it is.

katiejolly commented 3 years ago

San Francisco is one of the few cities that's also a county. And I already knew the code for getting the county boundaries, although they're interchangeable here.

On Tue, Apr 13, 2021 at 8:55 PM David Keyes @.***> wrote:

Wow, awesome! Question for you: I see you use both the city + county of San Francisco. Are they different? Why use both? I'm sure there's a good reason, but I don't know what it is.

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://github.com/rfortherestofus/api-food-asset-map/issues/11#issuecomment-819209948, or unsubscribe https://github.com/notifications/unsubscribe-auth/AFCZ4HPNCVNLCT3HNDYBT3DTIUG43ANCNFSM42PXJEFA .

dgkeyes commented 3 years ago

Got it, thanks!

katiejolly commented 3 years ago

I found an issue with all the OSM data-- I thought that pulling points would give me the centroid, but it was actually giving all the corners of the building which is why there were so many with blank attributes. Editing all those queries now to pull the polygon but just extract the centroid!

dgkeyes commented 3 years ago

Super! I'm glad I have you working on this because this is already getting beyond my knowledge levels.

katiejolly commented 3 years ago

Closing this issue.

In the end I combined the point and polygon data, I figured out they were unique datasets. Essentially, only the largest stores had the full polygons drawn out. Others only had points.