abhishekbhalani / abot

Automatically exported from code.google.com/p/abot
Apache License 2.0
1 stars 0 forks source link

Add MaxTimeToCrawl configuration #25

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago
Add MaxTimeToCrawl configuration. Crawl times out after this limit is reached.

Original issue reported on code.google.com by sjdir...@gmail.com on 7 Nov 2012 at 3:31

GoogleCodeExporter commented 9 years ago
Also consider other types of setting like this...

http://phpcrawl.cuab.de/example.html

Original comment by sjdir...@gmail.com on 7 Nov 2012 at 3:34

GoogleCodeExporter commented 9 years ago
Duplicate that was fixed in 1.0

Original comment by sjdir...@gmail.com on 23 Nov 2012 at 11:55