Closed GoogleCodeExporter closed 9 years ago
isForcedLinkParsingEnabled="false"
Original comment by sjdir...@gmail.com
on 3 May 2013 at 12:02
crawler.Crawl(uri, cancellationtokensource)
Original comment by sjdir...@gmail.com
on 3 May 2013 at 11:59
PageToCrawl.PageBag
Original comment by sjdir...@gmail.com
on 4 May 2013 at 12:36
TaskThreadManager new default to better support task cancellation
Original comment by sjdir...@gmail.com
on 27 Jun 2013 at 6:20
if MaxConcurrentThreads == 0 will use System.Thread.ProcessorCount
Original comment by sjdir...@gmail.com
on 29 Jun 2013 at 1:50
isRespectMetaRobotsNoFollowEnabled
isRespectAnchorRelNoFollowEnabled
Original comment by sjdir...@gmail.com
on 21 Jul 2013 at 11:33
Original comment by sjdir...@gmail.com
on 3 Sep 2013 at 1:47
.RawContent replaced with .Content.Text
.PageSizeInBytes replaced with .Content.Bytes.Length
Original comment by sjdir...@gmail.com
on 16 Sep 2013 at 11:48
IsDeepCrawlEnabled, new Scheduler, etc..
Original comment by sjdir...@gmail.com
on 23 Oct 2013 at 3:51
No IsDeepCrawlEnabled value (rolled back) but instead DeepWebCrawler and
ShallowWebCrawler
Original comment by sjdir...@gmail.com
on 5 Nov 2013 at 11:58
Contribution wiki page links to v1d1, be sure nothing else is hard linked to
old docs when this is deployed.
Original comment by sjdir...@gmail.com
on 6 Nov 2013 at 12:42
Links to source files on
https://code.google.com/p/abot/wiki/v1d1CustomizingCrawlBehavior are pointing
to google code svn repo. need to point them to git master.
Original comment by sjdir...@gmail.com
on 6 Nov 2013 at 12:46
CrawledPage.Content.Bytes in place of CrawledPage.Bytes
PageToCrawl.PageBag
Original comment by sjdir...@gmail.com
on 19 Dec 2013 at 5:26
You have to run a nuget install inside of commoner/ directory
Original comment by sjdir...@gmail.com
on 20 Jan 2014 at 2:24
With last comment...
C:\WorkRoot\Code\Abot\commoner>".nuget/nuget" restore Commoner.sln
Original comment by sjdir...@gmail.com
on 20 Jan 2014 at 2:33
abotlog.txt instead of log.txt
Original comment by sjdir...@gmail.com
on 29 Jan 2014 at 4:22
Original comment by sjdir...@gmail.com
on 3 Feb 2014 at 4:21
Original issue reported on code.google.com by
sjdir...@gmail.com
on 3 May 2013 at 12:02