yatish27 / linkedin-scraper

Scrapes the public profile of the linkedin page
MIT License
555 stars 220 forks source link

Scraper cannot scrape names somtimes #80

Closed wu-s-john closed 8 years ago

wu-s-john commented 8 years ago

Sometimes when I scrape my own profile with url="https://www.linkedin.com/in/johnwu93", I am able to get my name by doing Linkedin::Profile.get_profile(url).name

However, sometimes, this will not work and Linkedin::Profile.get_profile(url) will actually return nil. I looked at the issues and it seems that the console will output a connection error and then the function will return nil. However, for my case, the console does not putout anything. Is there a way to fix this?

oskarlakner commented 8 years ago

LinkedIn sometimes blocks connections. You should use proxy or tor.

yatish27 commented 8 years ago

Use proxy instantproxies