google-code-export abot issues

google-code-export / abot

Automatically exported from code.google.com/p/abot

0 stars 0 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

I can't crawl all the pages of a site

#130 GoogleCodeExporter opened 9 years ago
2
AutoMapper MappingException after update

#129 GoogleCodeExporter closed 9 years ago
8
'Abot.Poco.CrawlResult' does not contain a definition for 'ErrorMessage'

#128 GoogleCodeExporter closed 9 years ago
1
Using ampersand in URLs causes "Page has no content"

#127 GoogleCodeExporter closed 9 years ago
1
Github bugs/issues

#126 GoogleCodeExporter closed 9 years ago
1
Possibility to stop crawling (and start crawling async)

#125 GoogleCodeExporter closed 9 years ago
1
Retry crawl on webexception because of a bad proxy

#124 GoogleCodeExporter closed 9 years ago
1
Encoding issue

#123 GoogleCodeExporter closed 9 years ago
1
Ability to add metadata to crawl queue

#122 GoogleCodeExporter closed 9 years ago
5
Very slow

#121 GoogleCodeExporter closed 9 years ago
7
Remove all marked with [Obsolete] attribute

#120 GoogleCodeExporter opened 9 years ago
0
MaxPagesToCrawl is broken

#119 GoogleCodeExporter closed 9 years ago
2
RobotsDotText implementation disallows all external pages

#118 GoogleCodeExporter closed 9 years ago
2
Incorrectly parsing robots.txt

#117 GoogleCodeExporter closed 9 years ago
13
How to download the crawled web pages

#116 GoogleCodeExporter closed 9 years ago
1
Abot.SiteSimulator.casproj can not be opened

#115 GoogleCodeExporter closed 9 years ago
4
It's great but could not save session (it's very important)

#114 GoogleCodeExporter opened 9 years ago
7
Converting RawContent to a byte stream and writing to disk corrupts the data

#113 GoogleCodeExporter closed 9 years ago
9
Create an auto encoding solution that detects the decoding of each page based on headers

#112 GoogleCodeExporter closed 9 years ago
9
When set to not crawl external links, They are still added to scheduler to be crawled and later skipped

#111 GoogleCodeExporter closed 9 years ago
9
Seperate http web requests and processing onto seperate threads

#110 GoogleCodeExporter opened 9 years ago
2
Add "Advanced Usage" documentation

#109 GoogleCodeExporter closed 9 years ago
3
Suggestion: Allow to crawl basied on an xml sitemap

#108 GoogleCodeExporter closed 9 years ago
4
Suggested feature: More configurable logging w/ log4net

#107 GoogleCodeExporter closed 9 years ago
4
Reference to Abot.dll is broken

#106 GoogleCodeExporter closed 9 years ago
1
Memory leakage

#105 GoogleCodeExporter closed 9 years ago
3
consider using ilmerge again to consolidate dependencies

#104 GoogleCodeExporter closed 9 years ago
3
Update documentation for Abot.Core.ConfigurationSectionHandler

#103 GoogleCodeExporter closed 9 years ago
1
Create code project article

#102 GoogleCodeExporter opened 9 years ago
5
Add dynamic Expando object to CrawledPage

#101 GoogleCodeExporter closed 9 years ago
2
Update documentation to reflect 1.2 changes

#100 GoogleCodeExporter closed 9 years ago
17
Add isForcedLinkParsingEnabled that will parse links even if the links on that page should not be crawled

#99 GoogleCodeExporter closed 9 years ago
1
Test TaskThreadManager to see if it can become the default IThreadManager

#98 GoogleCodeExporter closed 9 years ago
5
Add proxy list to the crawler

#97 GoogleCodeExporter closed 9 years ago
1
Add better cancellation to signal "hard stop"

#96 GoogleCodeExporter closed 9 years ago
3
Update TaskThreadManager to use the ManualResetEvent to avoid busy wait

#95 GoogleCodeExporter closed 9 years ago
1
SiteSimulator integration test fails on zoogle.com external link (301 instead of 200)

#94 GoogleCodeExporter closed 9 years ago
1
If maxConcurrentThreads is 0, then use System.Environment.ProcessorCount

#93 GoogleCodeExporter closed 9 years ago
2
Support the crawling of a relatively unlimited number of sites/pages by a single crawler instance

#92 GoogleCodeExporter closed 9 years ago
17
Suggestion

#91 GoogleCodeExporter closed 9 years ago
1
Create automated performance tests

#90 GoogleCodeExporter opened 9 years ago
2
Create a build server

#89 GoogleCodeExporter closed 9 years ago
5
Add javascript links parser

#88 GoogleCodeExporter opened 9 years ago
11
Create a nothing to something with abot video

#87 GoogleCodeExporter opened 9 years ago
5
Demo crashes in mono

#86 GoogleCodeExporter closed 9 years ago
7
Consider getting back on nuget

#85 GoogleCodeExporter closed 9 years ago
4
Tune Abot to run well on mono

#84 GoogleCodeExporter opened 9 years ago
2
Change CrawlContext.CrawledUrls to ConcurrentDictionary for faster lookup

#83 GoogleCodeExporter closed 9 years ago
2
HyperLinkParser in conjunction with http redirects

#82 GoogleCodeExporter closed 9 years ago
5
Add MaxCrawlDepth property

#81 GoogleCodeExporter closed 9 years ago
2