Would it be possible to automatically load "show more" content?

spinlud / py-linkedin-jobs-scraper

MIT License

311 stars 86 forks source link

Would it be possible to automatically load "show more" content? #20

Open hlkong opened 2 years ago

hlkong commented 2 years ago

Hi! Amazing program! Just wondering would it be possible to also scrape the content hidden by "show more" button? I was trying to do some language analysis of the job descriptions but many of them are truncated by this "show more" thing...

Thanks!

spinlud commented 2 years ago

Hi there! Are you using authenticated session? It should not display a "show more" button, instead the pagination should look like the following: