joeyism / linkedin_scraper

A library that scrapes Linkedin for user data
GNU General Public License v3.0
2.12k stars 583 forks source link

add job filter keywords to avoid 429 error #188

Closed an-bluecat closed 1 year ago

an-bluecat commented 1 year ago

Problem: for anonamous strategy, currently we have to slow down the by setting a very long interval because we are looking into every job in details, clicking into it to get the job place, date, and descriptions.

Potential solution: add a regex filter on the API so that we don't have to click into every job and only click into jobs that is really interesting to us.

@joeyism Do you think that's a good idea? If so, I can write it up and create a pull request.