search

opensangja / abot

Automatically exported from code.google.com/p/abot
Apache License 2.0
0 stars 0 forks source link

Implement manual crawl delay #39

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago 
Implement manual crawl delay

Original issue reported on code.google.com by sjdir...@gmail.com on 21 Nov 2012 at 11:15

GoogleCodeExporter commented 9 years ago

Original comment by sjdir...@gmail.com on 22 Nov 2012 at 5:47

GoogleCodeExporter commented 9 years ago

Original comment by sjdir...@gmail.com on 22 Nov 2012 at 8:13

GoogleCodeExporter commented 9 years ago

Original comment by sjdir...@gmail.com on 23 Nov 2012 at 3:07

GoogleCodeExporter commented 9 years ago 
Completed, now a user can set minCrawlDelayPerDomainMilliSeconds in the 
app.config or the CrawlConfiguration.MinCrawlDelayPerDomainMilliSeconds 
manually to trigger manual crawl delay.

Original comment by sjdir...@gmail.com on 23 Nov 2012 at 11:50