linkedtales / scrapedin-linkedin-crawler

Crawler for LinkedIn full profiles 2019
Apache License 2.0
214 stars 71 forks source link

Scrape company employees #26

Open nicosh opened 4 years ago

nicosh commented 4 years ago

Is possible to retrieve users (and then scrape their profiles) from company url? Given a company url : https://www.linkedin.com/company/mycompany We can have a list of employees scraping : https://www.linkedin.com/company/mycompany/people/ There is any built-in functionality to achieve this or should i implement this by myself?

leonardiwagner commented 4 years ago

@nicosh no, currently we don't have this feature, but we're glad about receiving such contribution :smile:

this feature was already asked on scrapedin, see here , please read my comment about how this could be implemented, thank you!

gigaBITE397 commented 4 years ago

Hey,

As mentioned by @a10kiloham. I do want to work on Company data scrapper.

When I submit Company URL instead of the user Profile URL, the scrapper should go to the Company page then click on see all employees and then it will see all employee data.

  1. It should click on each employee and fetch data from the profile as we already do (one by one operation).
  2. Then, it should click on view more and continue its operation

Attached file for Step 1

Scrapper should repeat it's operation.

As you mentioned above, I tried Creating companyScrapperTemplate for Step 1 and created click functionality and see more functionality in those relative files.

But it does not seem to be working. Made required changes in other files but still the same.

company.zip

nicosh commented 4 years ago

@gigaBITE397 There is no need to scrape each Linkedin employee profile. Here is a really simple example on how you can scrape employees data from Company profile page.

jeremiah-94 commented 3 years ago

I do alot of LinkedIn scraping for company's employees as well but find it quite difficult running a scrapper due to the limitation in volume. I'm embarrassed to say but i ultimately gave up and resorted to a paid service, Mantheos which has an API that allows me to extract LinkedIn profile data at mass. Sharing here in case anyone requires something like this.

ganeshBUnbound commented 3 years ago

@nicosh I tried your method too, but using a voyager path means going through LinkedIn official APIs. I don't want to use that. I want to implement in the same way as we do for the contacts extraction. As @leonardiwagner said, I tried creating profile.js for the company too. But it's not working either.

wisdomcsharp commented 2 weeks ago

You can easily scrape company employees, using services linkedin outreach services like Linkedly AI

Once you're done, connect your flows with a webhook to services like zapier.. To feed the data to your other apps

Here's the Steps

  1. Get the Company URL
  2. Paste it, in the Company Employee section
  3. That's it done

Here's a screenshot

Screenshot 2024-06-15 at 3 44 08 PM