mozilla-mobile / prox-server

[INACTIVE] Server & data scripts for the Prox client.
https://github.com/mozilla-mobile/prox/
Mozilla Public License 2.0
5 stars 5 forks source link

Expand crawl to include TripAdvisor #103

Closed liuche closed 7 years ago

liuche commented 7 years ago

This matches items from Yelp to TripAdvisor, writes to our proxwalk db, and fetches TripAdvisor content and writes it to Firebase.

For timing, I test-ran this for 2km around the Chicago center - the crawl_base script takes 9.9s and finds 335 places, and this takes 4:07min matches 24 of those.

This doesn't add wikipedia, but I'll add that on top of this branch.

To run this, make sure you have an area crawled, and then run scripts/expandPlaces.py.