handle non existing selectors

bernardro / actor-youtube-scraper

Apify actor to scrape Youtube search results. You can set the maximum videos to scrape per page as well as the date from which to start scraping.

https://apify.com/bernardo/youtube-scraper

Apache License 2.0

23 stars 19 forks source link

handle non existing selectors #61

Closed levent91 closed 2 years ago

levent91 commented 2 years ago

Some non-video sections were causing errors which leads to retries. Added try & catch for those. Added a static wait while loading the page, networkidle2 appears to not wait enough.

I tested locally and it seems to be working well, lets try further