search

cal65 / Open-Rice

Scraping restaurant data from openrice.com, then geocoding coordinates. Analysis and visualization.
19 stars 4 forks source link

How did you scrape all restaurants? #1

Open markerit opened 7 years ago

markerit commented 7 years ago

Hi Cal, I am working on a project to scrape openrice restaurants data to do statistical modeling. I came across your project and it is very interesting. However, I am curious how did you scrape all restaurants to get the TotAll.csv file. When I went to their website, it seemed that page will show page=1 when you tried to visit page>17, for example: https://www.openrice.com/en/hongkong/restaurants?page=18

Please help! Thanks!

cal65 commented 7 years ago

Hi there,

You're right, openrice has changed their web structure and the scraping that I wrote no longer works. I will try to retackle the problem, but I'm sorry to disappoint - at the moment I don't have a solution for you.

Cal

On Tue, Nov 29, 2016 at 2:32 PM, markerit notifications@github.com wrote:

Hi Cal, I am working on a project to scrape openrice restaurants data to do statistical modeling. I came across your project and it is very interesting. However, I am curious how did you scrape all restaurants to get the TotAll.csv file. When I went to their website, it seemed that page will show page=1 when you tried to visit page>17, for example: https://www.openrice.com/en/hongkong/restaurants?page=18

Please help! Thanks!

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/cal65/Open-Rice/issues/1, or mute the thread https://github.com/notifications/unsubscribe-auth/ACa70NjLrtrewsxNCKmQdd98DdgDpxjxks5rDH3IgaJpZM4K_YZa .