Namit2111 / Linkedin-to-resume

Other
6 stars 9 forks source link

Find a Better Way to Fetch LinkedIn Data #1

Open Namit2111 opened 1 month ago

Namit2111 commented 1 month ago

The current method of fetching LinkedIn data using linkedin-api may have limitations or may not be the most efficient way. We need to explore other approaches that might offer better reliability, more features, or easier authentication processes. Tasks:

Investigate the limitations of the current linkedin-api method.
Research alternative methods for fetching LinkedIn data.
Implement and test the chosen method to ensure it improves efficiency and reliability.

Priority: High Type: Improvement

Rishitshivam commented 1 month ago

I would like to work and research on this issue, please assign it to me

ubaidrmn commented 1 month ago

I think using Microsoft's Sign in with linkedin API https://learn.microsoft.com/en-us/linkedin/consumer/integrations/self-serve/sign-in-with-linkedin could be a better option

Shawn11220 commented 1 month ago

How about we scrape the LinkedIn profiles of users? This can be a better alternative, which will only require users login credentials.

Namit2111 commented 1 month ago

I think using Microsoft's Sign in with linkedin API https://learn.microsoft.com/en-us/linkedin/consumer/integrations/self-serve/sign-in-with-linkedin could be a better option

Hey this seems promising are there any limitations? on rate limit ? cost?

Namit2111 commented 1 month ago

How about we scrape the LinkedIn profiles of users? This can be a better alternative, which will only require users login credentials.

Seems intresting can you elaborate on this

Shawn11220 commented 1 month ago

How about we scrape the LinkedIn profiles of users? This can be a better alternative, which will only require users login credentials.

Seems intresting can you elaborate on this

The idea is to login to LinkedIn through a browser using the login credentials and then scrape out the data using web scraping tools, finally saving the data in a JSON or .txt file.

NB - The login and scraping part will be automated through various python libraries. I can explain in detail if i can know exactly which LinkedIn data is needed.

Namit2111 commented 1 month ago

Basically the data needed is the users profile info as this project aims to combine all the users linkedin profile data to make a portfolio for user. @Shawn11220

Shawn11220 commented 1 month ago

Basically the data needed is the users profile info as this project aims to combine all the users linkedin profile data to make a portfolio for user. @Shawn11220

Yes, we can scrape the whole profile section content from LinkedIn Profile.

Namit2111 commented 1 month ago

Basically the data needed is the users profile info as this project aims to combine all the users linkedin profile data to make a portfolio for user. @Shawn11220

Yes, we can scrape the whole profile section content from LinkedIn Profile.

sounds good!

Shawn11220 commented 1 month ago

Basically the data needed is the users profile info as this project aims to combine all the users linkedin profile data to make a portfolio for user. @Shawn11220

Yes, we can scrape the whole profile section content from LinkedIn Profile.

sounds good!

lemme run a test subject, if it works then i'll share as a py file.

Shawn11220 commented 1 month ago

Hey @Namit2111 Forgot to mention, this method is platform dependent (it requires a browser to work - specifically chrome)

Namit2111 commented 1 month ago

Hey @Namit2111 Forgot to mention, this method is platform dependent (it requires a browser to work - specifically chrome)

why only chrome?also will it be compatible with smart phones?

Shawn11220 commented 1 month ago

Hey @Namit2111 Forgot to mention, this method is platform dependent (it requires a browser to work - specifically chrome)

why only chrome?also will it be compatible with smart phones?

Chrome is ideally available , and for the compatibility with smartphones ,I never tried on smartphones. Gotta try it out on Android/iOS

VincenzoMeschi commented 1 week ago

Just to add an idea to the discussion, Upwork has an interesting way of using Linkedin data.

image

They parse the PDF export of a profile. This could be a possible way to fetch data too.