Scrap NIPS data directly from the ACM website.

D61-IA / stellar-gnosis

Gnosis paper management and collaboration tool

Apache License 2.0

0 stars 1 forks source link

Scrap NIPS data directly from the ACM website. #72

Closed Zhenghao-Zhao closed 4 years ago

Zhenghao-Zhao commented 4 years ago

You can find all NIPS articles following this link: https://dl.acm.org/conference/nips/proceedings

My goal is to scrap data from those articles.

Zhenghao-Zhao commented 4 years ago

My attempt at bulk import NIPS data from ACM website has failed as my IP Address has been blocked as I was running the script. I think they might have a policy that does not allow automated processes like that but I am unable to find such policy on their website.

Zhenghao-Zhao commented 4 years ago

Here are some workarounds: https://hackernoon.com/how-to-scrape-a-website-without-getting-blacklisted-271a605a0d94