search

rc-dining-bot / scraper

Scrapes NUS Daily Menu pdfs for RC meal plan data.
0 stars 1 forks source link

Incapsula blocking #5

Open qinghao1 opened 4 years ago

qinghao1 commented 4 years ago

Hi, seems like Incapsula is blocking the PDF links too now. Are you seeing this problem and do you have any workarounds?

In the meantime, we're contacting NUS IT to see if they can help with this issue. Will update here if they reply.

jonchan51 commented 4 years ago

We couldn’t find a nice workaround either. One thing you can do to temporarily bypass it is to access the page manually on a browser, copy the cookies created (which expire not long later), and include those cookies as part of the requests to the pdf links.