-
## What happened?
I am crawling the site https://www.disfrutadubai.com and it is working great. I tried to change from HTTPS to HTTP, I got a 301 redirection but no further pages crawled. Then I craw…
-
A scenario we're looking to use the Filesystem Collector on is to crawl a collection of textual metadata files on the file system (one file per document) - we can use taggers in the preparsehandlers t…
-
```
What steps will reproduce the problem?
1.
2.
3.
What is the expected output? What do you see instead?
What version of the product are you using?
Crawler4j 3.5
Please provide any additional inf…
-
# Describe the bug
This issue concerns a (fairly popular) third-party Spigot plugin, [GSit](https://spigotmc.org/resources/62325).
Possibly-related past PRs include #1518 and #1510.
## What wor…
-
Probably because the site that I'm crawling has an pretty high amount of resources. Though, I wonder if this isn't preventable? Am I overlooking an option here?
-
The pause and stop buttons while crawling is going on are disabled. Is the pause and stop feature available?
-
```
Randomly waits before crawling a pages. Sleep time is completely random.
```
Original issue reported on code.google.com by `sjdir...@gmail.com` on 13 Dec 2012 at 8:24
-
```
Randomly waits before crawling a pages. Sleep time is completely random.
```
Original issue reported on code.google.com by `sjdir...@gmail.com` on 13 Dec 2012 at 8:24
-
```
Randomly waits before crawling a pages. Sleep time is completely random.
```
Original issue reported on code.google.com by `sjdir...@gmail.com` on 13 Dec 2012 at 8:24
-
When logged in Facebook I get a popup when choosing to see comments (not on all Facebook-pages but on some - see below). This new behaviour is not supported in archiveweb.page and the AutoPilot-funct…