search

BruceDone / awesome-crawler

A collection of awesome web crawler,spider in different languages
MIT License
6.36k stars 688 forks source link

Added SimpleCrawler #50

Closed berti92 closed 4 years ago

berti92 commented 5 years ago

I created an easy app to crawl any webpage fast and polite as text file, because everything you mentioned was not really usable out of the box