OriginLive / SpideR

A web crawler engine that gathers data, sorts it and outputs it to file. The goal is for it to be fully customizable and extensible, with possibilities for scripting the behaviour of the spiders.
MIT License
2 stars 3 forks source link

First Major Synch #3

Closed kingRodian closed 7 years ago