revan / RU-Food-Scraper

Scrapes basic nutrition information for Rutgers menus into JSON.
http://vps.rsopher.com/nutrition.json
3 stars 5 forks source link

Does this still work? #7

Closed BTruer closed 6 years ago

BTruer commented 6 years ago

Hi Revan and others,

I am trying to use your api at: http://vps.rsopher.com/nutrition.json and I get a good response (200) but nothing is returning meaning I get nothing or empty.

I took a look at http://menuportal.dining.rutgers.edu/foodpro/pickmenu.asp?sName=Rutgers+University+Dining&locationNum=04&locationName=Busch+Dining+Hall&naFlag=1

and it looks like they have problems as well. Could this be because of their service? When I tried to run your scrape.py I get: File "/usr/lib/python3.5/urllib/request.py", line 590, in http_error_default raise HTTPError(req.full_url, code, msg, hdrs, fp) urllib.error.HTTPError: HTTP Error 500: Internal Server Error

Any thoughts?

Thank you!

revan commented 6 years ago

Hm weird, I can't check the site from here (tells me it's blocked by administrator, might be because of my Cambodian IP). Can take a look when I'm back in the country.

If you're having trouble accessing the site too though, then no surprise that the scraper is broken -- did they maybe change the URL?

On Mon, Nov 20, 2017, 10:57 AM Bhargav Tarpara notifications@github.com wrote:

Hi Revan and others,

I am trying to use your api at: http://vps.rsopher.com/nutrition.json and I get a good response (200) but nothing is returning meaning I get nothing or empty.

I took a look at http://menuportal.dining.rutgers.edu/foodpro/pickmenu.asp?sName=Rutgers+University+Dining&locationNum=04&locationName=Busch+Dining+Hall&naFlag=1

and it looks like they have problems as well. Could this be because of their service? When I tried to run your scrape.py I get: File "/usr/lib/python3.5/urllib/request.py", line 590, in http_error_default raise HTTPError(req.full_url, code, msg, hdrs, fp) urllib.error.HTTPError: HTTP Error 500: Internal Server Error

Any thoughts?

Thank you!

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/revan/RU-Food-Scraper/issues/7, or mute the thread https://github.com/notifications/unsubscribe-auth/ABDz-GaCGxMIavWWWe2LMnaV6zo9L7wJks5s4Pi0gaJpZM4QjtnF .

revan commented 6 years ago

Seems to be working fine now, so it was probably just upstream issues.