Deep Crawling - Githubissues

FriendsOfPHP / Goutte

Goutte, a simple PHP Web Scraper

MIT License

9.26k stars 1.01k forks source link

Deep Crawling #372

Open Basuri opened 5 years ago

Basuri commented 5 years ago

Hi,

I build a crawler with this library. But when I comparing with some other online crawlers, this library not listing all urls. Some times this library crawl only 100 urls. How can I maximise this?