icareerclimber / career-skills-capstone

See our product website:
https://icareerclimber.github.io/
MIT License
0 stars 1 forks source link

LinkedIn scraping #4

Open kbelsvik opened 6 years ago

kbelsvik commented 6 years ago

Based on the searching that I've done, it seems that LinkedIn is pretty aggressive about preventing web scraping of public profiles. Blacklisting IP addresses making large number of requests. There is an ongoing lawsuit between LinkedIn and a company called hiQ dealing with whether or not LinkedIn can prevent the scraping of their publicly available data.