Add MaxTimeToCrawl configuration

nikhilgeit / abot

Automatically exported from code.google.com/p/abot

Apache License 2.0

0 stars 0 forks source link

Closed GoogleCodeExporter closed 8 years ago

GoogleCodeExporter commented 8 years ago

Add MaxTimeToCrawl configuration. Crawl times out after this limit is reached.

Original issue reported on code.google.com by sjdir...@gmail.com on 7 Nov 2012 at 3:31

GoogleCodeExporter commented 8 years ago

Also consider other types of setting like this...

http://phpcrawl.cuab.de/example.html

Original comment by sjdir...@gmail.com on 7 Nov 2012 at 3:34

GoogleCodeExporter commented 8 years ago

Duplicate that was fixed in 1.0

Original comment by sjdir...@gmail.com on 23 Nov 2012 at 11:55