-
```
child URL missing in Printf
```
Original issue reported on code.google.com by `ort...@gmail.com` on 20 Jul 2014 at 4:16
Attachments:
- [webcrawler.go.patch](https://storage.googleapis.com/google…
-
```
It doesn't reduce the depth when calling crawl recursively, so the the depth is
ineffective currently.
```
Original issue reported on code.google.com by `joelai85` on 26 Oct 2012 at 6:18
-
```
child URL missing in Printf
```
Original issue reported on code.google.com by `ort...@gmail.com` on 20 Jul 2014 at 4:16
Attachments:
- [webcrawler.go.patch](https://storage.googleapis.com/google…
-
```
It doesn't reduce the depth when calling crawl recursively, so the the depth is
ineffective currently.
```
Original issue reported on code.google.com by `joelai85` on 26 Oct 2012 at 6:18
-
Hello,
I'm using a HyperLinkParser like this:
```
public class MyHyperLinkParser : IHyperLinkParser
{
public Uri Base { get; set; }
public HtmlParser HtmlParser { get; set; } = new HtmlParse…
-
The draft http://www.robotstxt.org/norobots-rfc.txt
mentions of having multiple User-agent in a record to share rules.
Would you think it possible to support this syntax?
```
User-agent: webcrawler
#…
-
Hi,
I just installed Abot from NuGet did a quik test code:
```
using System;
using Abot.Crawler;
using Abot.Poco;
namespace WebCrawler
{
public class Program
{
public static void M…
ghost updated
8 years ago
-
```
child URL missing in Printf
```
Original issue reported on code.google.com by `ort...@gmail.com` on 20 Jul 2014 at 4:16
Attachments:
- [webcrawler.go.patch](https://storage.googleapis.com/google…
-
```
child URL missing in Printf
```
Original issue reported on code.google.com by `ort...@gmail.com` on 20 Jul 2014 at 4:16
Attachments:
- [webcrawler.go.patch](https://storage.googleapis.com/google…
-
## Veil version 3.0
## OS Used - all info (architecture, linux flavor, etc) Kali Rolling
## Pastebin link to error you are encountering (include console actions you took prior to error)
roo…