How many profiles can I scrape simultaneously with the Parallel Scraper?

austinoboyle / scrape-linkedin-selenium

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.

MIT License

457 stars 162 forks source link

How many profiles can I scrape simultaneously with the Parallel Scraper? #44

Open samanthad97 opened 5 years ago

samanthad97 commented 5 years ago

Hi! I was wondering if anyone knew how many profiles I can scrape simultaneously with the Parallel Scraper function before being flagged or blocked by Linkedin? I have a list of 100 profiles that I would like to scrape and wasn't sure how to best configure the parallel scraper function to accommodate this request. Any input helps!

Thank you :)

austinoboyle commented 4 years ago

I don't think anybody has an exact number here. I would suggest erring on the side of caution - 100 profiles shouldn't take that long, even just 1 or 2 at a time.

ThinkCode commented 1 year ago

What is the limit LinkedIn imposes per day? Can we search for 10,000 people in one day to see where they work at?