yatish27 / linkedin-scraper

Scrapes the public profile of the linkedin page
MIT License
552 stars 221 forks source link

Company names are empty #37

Closed dboundz closed 9 years ago

dboundz commented 9 years ago

The past_companies collection is populated but the company names are empty for all but the first position.

Profile used: https://www.linkedin.com/in/darrenbounds

yatish27 commented 9 years ago

Let me look into it

louwersj commented 9 years ago

I have noticed the same issue... the majority of the companies are empty... also start_date and end_date are null (all tested in the JSON view)

yatish27 commented 9 years ago

I will work on it tonight

On Thursday, January 1, 2015, Johan Louwers notifications@github.com wrote:

I have noticed the same issue... the majority of the companies are empty... also start_date and end_date are null (all tested in the JSON view)

Reply to this email directly or view it on GitHub https://github.com/yatish27/linkedin-scraper/issues/37#issuecomment-68490124 .

Yatish Mehta

louwersj commented 9 years ago

Hi Yatish, sounds great... would be cool if this can be resolved as it will make the tool much more useful. I am looking into how I can use it to map social network connection by making use of neo4j... your code would really help as a feeder into neo4j :-)

Very much appreciated if you can fix this as I am not a ruby developer :-)

yatish27 commented 9 years ago

@louwersj which profile link are you testing it on

yatish27 commented 9 years ago

@dbounds The code in master gives this output http://pastebin.com/WWhCjZpp

louwersj commented 9 years ago

As an example I am using: https://www.linkedin.com/in/meetjohndo as an example however I do notice it at a lot more links.... When I look at the JSON output I notice that the company sections are empty for this person (in some cases)

I also noticed that for the recommended_visitors section in some cases the same applies.

Johan.

yatish27 commented 9 years ago

I tried it worked for me. Try to install 0.1.5 version and then test

cyberfab007 commented 9 years ago

has anyone got a version working with proxies yet ?

cyberfab007 commented 9 years ago

if not I would be glad it get that done :)

yatish27 commented 9 years ago

@cyberfab007 You can raise a PR

wyngit commented 9 years ago

Hello yatish, thanks so much for your efforts in this. I now have the reverse problem for some profiles: the current company field is populated, but the past companies fields are empty.

The profile in question is: http://www.linkedin.com/in/chicjai

Thanks again.