sjdirect abot issues - Githubissues

sjdirect / abot

Cross Platform C# web crawler framework built for speed and flexibility. Please star this project! +1.

Apache License 2.0

2.25k stars 560 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

How do I configure the default HttpClientHandler ?

#242 mediabuff opened 7 months ago
0
Add SourceContext to log routines

#241 nefarius opened 8 months ago
0
Cancellation is not working properly and integration test is wrong

#240 kpiekara opened 1 year ago
1
ExtractRedirectUri method does not work properly in Linux

#239 pbehin opened 1 year ago
0
Content.Text empty despite response code OK and Content stream contains data

#238 seanarmstrong87 opened 1 year ago
0
Crawl .jsp sites

#237 Cizzl closed 2 years ago
0
Enable re-use of HttpClient instances

#236 backcode-dev closed 2 years ago
1
Are 304 responses properly handled?

#235 replaysMike closed 2 years ago
2
Control maximum number of concurrent pages to be crawled

#234 mrmashal closed 3 years ago
1
Question

#233 GioviQ closed 3 years ago
1
Improved base tag handling

#232 thedeedawg closed 3 years ago
2
Base URI logic of the HyperLinkParser doesn't respect terminated relative base tag values

#231 thedeedawg closed 3 years ago
2
Base URI logic of the HyperLinkParser breaks on Linux when faced with a root-relative base tag value

#230 thedeedawg closed 3 years ago
2
Exception is thrown when redirect URI is relative

#229 chjahnert closed 3 years ago
1
The PageRequester downloads the content by default

#228 chjahnert opened 3 years ago
1
How do I direct it to crawl, specifc paged content in a site directory?

#227 tinonetic closed 3 years ago
2
Remove ThreadManager

#226 YairHalberstadt closed 3 years ago
3
Incorrect usage of ThreadManager means it does nothing

#225 YairHalberstadt closed 3 years ago
4
Best way to do page-by-page crawling

#224 okolobaxa closed 3 years ago
2
Meta Tag Crawling

#223 shaun-hutch closed 3 years ago
0
Handling pagination

#222 thebitbrine closed 4 years ago
1
Bot stop crawling without any error

#221 Alex-queval1 closed 4 years ago
0
Sitemap.xml parsedlinks is empty

#220 JoshTango closed 3 years ago
5
Collection of links found

#219 JoshTango closed 4 years ago
1
Update Readme file?

#218 JoshTango closed 4 years ago
1
User Agent config value appears to be getting split on spaces and sending requests with multiple user-agent headers

#217 entryspace closed 4 years ago
2
How to implement the decision maker function

#216 kunal0810 closed 4 years ago
1
Meta Tag Crawling

#215 shaun-hutch closed 4 years ago
1
Fix missing Read with encoding in abot2

#214 RazmikGevorgyan closed 4 years ago
1
Subdomains links are treated as external links

#213 marcmarsinach closed 4 years ago
1
Encoding not applied when getting content from response on Abot2

#212 marcmarsinach closed 4 years ago
1
Getting remote server error 430 whenever I run, tried on few websites.

#211 gbarnis closed 4 years ago
2
Abot as Static Site Generator

#210 glikoz closed 4 years ago
1
Documentation out of date and demo project doesn't compile

#209 nzbart closed 4 years ago
3
Remove Async events from readme example

#208 JulioPablo closed 4 years ago
0
Cannot access Async events in newest version

#207 JulioPablo closed 4 years ago
3
Abot Crawler Cancellation Not Working As Per README.md

#206 RadwanRadoo closed 4 years ago
4
Can't install package in VS 2017

#205 MESWEB closed 5 years ago
1
abot vs abot v2?

#204 fatagun closed 5 years ago
1
Library does not work when link crawled is very slow

#203 sbonello closed 5 years ago
11
Dotnet standard

#202 sjdirect closed 5 years ago
0
Fails to load some websites

#201 mohodhaka closed 5 years ago
1
Status on dotnet standard and dotnet core support

#200 silashansen closed 5 years ago
4
Change visibility of method GetRawData

#199 rbvictor closed 5 years ago
0
Abot is incompatible with 1.6.0.15 with AngleSharp 0.10.0

#198 xudonax closed 5 years ago
0
Spelling corrections.

#197 dougouk closed 5 years ago
1
Changed visibility in some class fields

#196 rbvictor closed 5 years ago
2
Workaround for using standard HtmlAgilityPack library

#195 rbvictor closed 5 years ago
0
Make method `GetRateLimiter` overridable

#194 rbvictor closed 5 years ago
3
UseDefaultCredentials possibility

#193 Evirth closed 6 years ago
1