josephlimtech / linkedin-profile-scraper-api

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON.
MIT License
545 stars 146 forks source link

scraping linkedin anonymously? #46

Open megalancast opened 1 year ago

megalancast commented 1 year ago

Is it possible to extract profile and company data without entering my login and password?

restyler commented 1 year ago

After trying a few linkedin apis on rapidapi I have built https://rapidapi.com/restyler/api/linkedin-profiles1 - it is a simple api but it packs a lot of my experience building sophisticated web scrapers, under the hood, it helps to access public linkedin profiles and companies without logging in.

josephlimtech commented 1 year ago

Yes, that is possible (For public data). However, LinkedIn has a very high block rate for suspicious requests.

Another solution you can try is using a mobile proxy and rotating that proxy before the pattern on when LinkedIn gives login prompt to your request.

Also, if you don’t want to get your hands messy, you can try a third party.

For example, some companies provide APIs that allow you to get public data from LinkedIn.

As far as I know, the most affordable in terms of price and performance is Proxycurl. You can try this as simply as making a usual request.

Here’s an example of how to get a LinkedIn person’s profile using Proxycurl:

curl \
    -G \
    -H "Authorization: Bearer ${YOUR_API_KEY}" \
    'https://nubela.co/proxycurl/api/v2/linkedin' \
    --data-urlencode 'linkedin_profile_url=https://linkedin.com/in/johnrmarty/'

They also provide some external data (like GitHub, Twitter, Facebook) along with profile data that you may need.

turk commented 8 months ago

You can use it with 3rd party paid service. https://rapidapi.com/rockapis-rockapis-default/api/linkedin-api8