c4software / python-sitemap

Mini website crawler to make sitemap from a website.
GNU General Public License v3.0
366 stars 110 forks source link

Verbose output and fix robots.txt bug #18

Closed Garrett-R closed 7 years ago

Garrett-R commented 7 years ago

I hope you don't mind me combining two independent commits into 1 PR (feel free to review each commit individually).

I think the verbose option is nice because otherwise you're not sure if it's frozen or actually doing stuff.

c4software commented 7 years ago

Nice addition thanks for your proposal.

I have made some change like removing the self.verbose to use the logging.LEVEL instead (Not very clear… but take a look at my modification ;))

Garrett-R commented 7 years ago

Oh yeah, that was a good call, thanks!