theanti9 / PyCrawler

A python web crawler
212 stars 103 forks source link

Removed anchor links from queue in ready_queue #15

Open John61590 opened 10 years ago