spinlud / py-linkedin-jobs-scraper

MIT License
311 stars 86 forks source link

LinkedIn changed selector #22

Closed src73 closed 2 years ago

src73 commented 2 years ago

Hi, I was getting no jobs found for common authenticated searches like "MBA". It looks like LinkedIn changed the name of the container that the scraper uses to validate that the page has loaded. The old and new selector seem to be:

#old search results container
'.jobs-search-two-pane__container'

#new search results container
'.scaffold-layout__list-container'

I'm not able to make a PR, but I was able to successfully scrape after I changed line 23 of authenticated-strategy.py to

container = '.scaffold-layout__list-container'

It looks like the other important selectors are still working, it's just the initial validation one that changed.

Thanks for making this very useful tool 😄

spinlud commented 2 years ago

Thank you sir! I've just updated the container selector, let me know if it works!