search

sethia4u / abot

Automatically exported from code.google.com/p/abot
Apache License 2.0
0 stars 0 forks source link

Possibility to stop crawling (and start crawling async) #125

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago 
Once the Crawl method has been called, there is no way to stop the crawling. 
This is a big issue when launching the crawler on big sites.

Original issue reported on code.google.com by finizio...@gmail.com on 17 Jan 2014 at 2:30

GoogleCodeExporter commented 9 years ago 
Cancellation was implemented in version 1.2.3 (not released yet but available 
here https://github.com/sjdirect/abot/tree/1.2.3). 

You can start the crawl asynchronously with cancellation support like so..

Task.Factory.StartNew( () => {
    crawler.Crawl(new Uri("http://aaa.com"), cancellationToken);
 }, cancellationToken)

Original comment by sjdir...@gmail.com on 17 Jan 2014 at 4:23