-
```
What steps will reproduce the problem?
1. I run a depth 0 crawl on a small set of urls.
2. After the crawler detects it is finished I receive:
INFO [Thread-7] It looks like no thread is working, …
-
```
What steps will reproduce the problem?
1. I run a depth 0 crawl on a small set of urls.
2. After the crawler detects it is finished I receive:
INFO [Thread-7] It looks like no thread is working, …
-
Given a redirect from http://www.mascus.com/agriculture/used-other-tractor-accessories/%D0%B3%D1%96%D0%B4%D1%80%D0%B0%D0%B2%D0%BB%D1%96%D0%BA%D0%B0-%D1%81%D0%BF%D0%B5%D1%86%D1%82%D0%B5%D1%85%D0%BD%D1%…
niels updated
8 years ago
-
```
What steps will reproduce the problem?
1. I run a depth 0 crawl on a small set of urls.
2. After the crawler detects it is finished I receive:
INFO [Thread-7] It looks like no thread is working, …
-
List of bots that are missing (detected by posting a link via twitter):
- [Applebot](http://www.apple.com/go/applebot)
- [ButterflyBot](http://labs.topsy.com/butterfly/) IP to exclude: 74.112.128.0/2…
-
This is a counter that will group hits by device type.
And, at least we have 3 access types:
1: desktop
2: mobile devices
3: other (eg: crawlers)
Very useful on analytics to apply some strategy.
des…
abgit updated
9 years ago
-
```
What steps will reproduce the problem?
1. I run a depth 0 crawl on a small set of urls.
2. After the crawler detects it is finished I receive:
INFO [Thread-7] It looks like no thread is working, …
-
```
What steps will reproduce the problem?
1. I run a depth 0 crawl on a small set of urls.
2. After the crawler detects it is finished I receive:
INFO [Thread-7] It looks like no thread is working, …
-
```
What steps will reproduce the problem?
1. I run a depth 0 crawl on a small set of urls.
2. After the crawler detects it is finished I receive:
INFO [Thread-7] It looks like no thread is working, …
-
Got a weird report from @davidpots:
```
http://neutral.fm/episodes?format=rss
http://atp.fm/episodes?format=rss
http://accidentalhousewives.com/feed/
http://theaccidentalpodcast.squarespace.com/podca…