issues
search
sjdirect
/
abot
Cross Platform C# web crawler framework built for speed and flexibility. Please star this project! +1.
Apache License 2.0
2.25k
stars
558
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
HtmlAgilityPack Assembly Version
#192
paulbackhouse
closed
5 years ago
3
Request aborted: Failed to create SSL/TLS secure channel.
#191
hzdlive
closed
6 years ago
0
Cannot crawl on specific site
#190
gbarnis
closed
6 years ago
1
Is AbotX supported on .NET Core?
#189
tudorserbanconnatix
closed
4 years ago
3
AccessViolationException thrown while crawling
#188
SchwarzChristian
closed
6 years ago
4
Abot is getting "Request aborted" on responses that should be standard http 404 status
#187
sjdirect
closed
5 years ago
6
Slash in robot txt is misinterpreted.
#186
johnsenola
closed
5 years ago
1
Add link text to ParsedLinks
#185
truencoa
closed
4 years ago
3
Not FIPS compliant
#184
lansdon2
closed
5 years ago
3
On MacOS it's not possible to build this project
#183
SabiKi
closed
4 years ago
1
Robots.txt is ignored when uri scheme is changed (http/https)
#182
askoutaris
closed
5 years ago
1
Is there any way to pass context from the Crawler invocation to the PageCrawlCompletedAsync method?
#181
tudorserbanconnatix
closed
6 years ago
1
where is the robots.dll ??
#180
longfeier
closed
5 years ago
0
user agent
#179
f103mirage
closed
6 years ago
1
Question: how do HttpServicePointConnectionLimit and MaxConcurrentThreads interact?
#178
benempson
closed
6 years ago
4
Update misleading HttpRequestTimeoutInSeconds XML comment
#177
seekingtheoptimal
closed
6 years ago
0
Abot AbotX TLS 1.2 Support, Could not create SSL/TLS secure channel
#176
wpkramer
opened
6 years ago
3
Different results from crawls with same settings
#175
benempson
closed
6 years ago
3
Disallowed page from Robots.txt is crawled - based on where link is detected.
#174
johnsenola
closed
5 years ago
0
Set HttpWebRequest Proxy null (Option over Config)
#173
Josma
closed
5 years ago
2
R# Cleanup
#172
ps-stevesheldon
closed
7 years ago
0
Number of pages to crawl
#170
fatagun
closed
6 years ago
3
Referencing HAP nuget package instead of external lib
#169
gurgendav
closed
7 years ago
0
Decision maker issue
#168
Cloudents
closed
7 years ago
0
Can I make ABot ignore images?
#167
YodasMyDad
closed
7 years ago
2
Can I cancel the page crawl in PageCrawlStartingAsync event?
#166
YodasMyDad
closed
7 years ago
2
Dotnet Core compatible nuget version?
#165
jb-reefer
closed
7 years ago
1
Will not work with HtmlAgilityPack?
#164
YodasMyDad
closed
7 years ago
6
Use HtmlDocument.MaxDepthLevel from latest HAP to replace local fix.
#163
ghost
closed
5 years ago
5
Whether can support the asp.net core
#162
Seanxwy
closed
7 years ago
1
Refactor per josefpihrt roslynator
#161
DickBaker
closed
7 years ago
1
Fixed issue of MaxNestedChildren to work with latest HtmlAgilityPack.
#160
ghost
closed
7 years ago
6
OptionFixNestedTags = false fixes nested issue
#159
ghost
closed
7 years ago
1
CrawledPage URI same as Parent URI
#158
wsTomBrower
closed
7 years ago
3
How to Use Abot to get specific product details from an online shop
#157
IkemNwodo
closed
7 years ago
1
Abot is not FIPS compliance
#156
sjdirect
closed
5 years ago
4
Logging in
#155
tallesl
closed
7 years ago
1
Disallow all pages with question mark.
#154
Jawoch
closed
7 years ago
2
Update dependency versions
#153
sjdirect
closed
7 years ago
0
Update dependency versions
#152
sjdirect
closed
7 years ago
2
Abot.Util.RateLimiter.ExitTimerCallback Exception "Object reference not set to an instance of an object"
#151
mlemanczyk
closed
5 years ago
3
Usage question
#150
josh-endries
closed
7 years ago
1
HtmlAgilityPack dependency removed?
#149
madebysoren
closed
7 years ago
3
Enable automatic decompression on HttpWebRequest
#148
harisco7
closed
8 years ago
1
Feature request - crawling predefined urls
#147
ShadowDancer
closed
8 years ago
5
Update to NUnit3.5
#146
terasato
closed
8 years ago
1
Question regarding PageCrawlCompletedAsync
#145
TeddyDreyfus
closed
8 years ago
5
Can I sort methods?
#144
terasato
closed
8 years ago
2
Abot not compatible with the latest version of log4net.
#143
terasato
closed
8 years ago
2
Abot not compatible with newer versions of AutoMapper
#142
sjdirect
closed
7 years ago
3
Previous
Next