PR for Issue #29 - Githubissues

rivermont / spidy

The simple, easy to use command line web crawler.

GNU General Public License v3.0

334 stars 69 forks source link

PR for Issue #29 #51

Closed Hrily closed 6 years ago

Hrily commented 6 years ago

PR for #29

Sorry for the late PR, I'm a little inexperienced with threading and I had to consider a lot of cases while designing the system.

Please review the code. I'll be updating the docs in subsequent commits.

Also, would you like me to write tests for this?

Checklist

[x] This Pull will not add the same thing as another currently-open request.
[x] Your Pull was made against the rivermont:dev branch and not rivermont:master.
[x] This Pull does not commit any keys, passwords, personal data, or other private information.
[x] I updated lines 20 and 21 in the README to reflect any changed I made.