-
```
What steps will reproduce the problem?
Use webcrawler to a url as seed that is down. Now, for example,
http://jquery.com/ is not working and webcrawler is freeze if I use this page.
What is the…
-
```
What steps will reproduce the problem?
1. use an example of http://vimeo.com/search?q=lectures as seed url
What is the expected output? What do you see instead?
Links to pages that are of type a…
-
```
child URL missing in Printf
```
Original issue reported on code.google.com by `ort...@gmail.com` on 20 Jul 2014 at 4:16
Attachments:
- [webcrawler.go.patch](https://storage.googleapis.com/google…
-
https://raw.githubusercontent.com/gentoo/gentoo/a8eb7d7fa7bb9ceaec76cdb7c536434141160edf/www-client/httrack/httrack-3.48.21-r1.ebuild
-
```
Make crawlconfiguration modifiable after it is loaded from app.config file
```
Original issue reported on code.google.com by `sjdir...@gmail.com` on 4 Feb 2013 at 8:17
-
```
It doesn't reduce the depth when calling crawl recursively, so the the depth is
ineffective currently.
```
Original issue reported on code.google.com by `joelai85` on 26 Oct 2012 at 6:18
-
```
What steps will reproduce the problem?
1. I am using a list of urls to start many concurrent web crawlers using your
libraries, I was very keen on synchronization issues and so on.
2. Run the cra…
-
-
```
What steps will reproduce the problem?
1.user a WebCrawler。
2.you will found all urls are changed to lower case。
3.some website will redirect url when it is lowercase
(http://www.amazon.cn/) ,so …
-
```
What steps will reproduce the problem?
java.lang.NullPointerException
at edu.uci.ics.crawler4j.frontier.DocIDServer.getDocID(DocIDServer.java:70)
at edu.uci.ics.crawler4j.crawler.WebCrawle…