-
```
What steps will reproduce the problem?
1. Create a web-page with a malformed URL (or a protocol like mailto:)
2. Run the crawler on said website.
3. Crash and burn at line 89 in WebURL.java - this…
-
```
What steps will reproduce the problem?
1. Create a web-page with a malformed URL (or a protocol like mailto:)
2. Run the crawler on said website.
3. Crash and burn at line 89 in WebURL.java - this…
-
```
What steps will reproduce the problem?
1. Create a web-page with a malformed URL (or a protocol like mailto:)
2. Run the crawler on said website.
3. Crash and burn at line 89 in WebURL.java - this…
-
## Summary
With the `JOBDIR` setting the documentation states each spider should utilize its own directory, while there is nothing currently in place to automatically handle this as there is fo…
-
```
Siguiendo la investigacion e tracebacks abtenidos con el crawler [0], teniamos
en cdpedia.log dos tracebacks:
Traceback (most recent call last):
File "D:\tmp\pyinstaller-2.0\cdpedia\build\pyi.…
-
Inspect currently does not support any web interaction apart from web search.
As part of the effort of migrating [GDM Dangerous Capability evaluations](https://github.com/google-deepmind/dangerous…
-
```
What steps will reproduce the problem?
1. Create a web-page with a malformed URL (or a protocol like mailto:)
2. Run the crawler on said website.
3. Crash and burn at line 89 in WebURL.java - this…
-
```
What steps will reproduce the problem?
1. Create a web-page with a malformed URL (or a protocol like mailto:)
2. Run the crawler on said website.
3. Crash and burn at line 89 in WebURL.java - this…
-
LogCounterHandler increases crawler log_count stats for each record, but it should only increase them for logs from the crawler it is created by. This is an issue if you're running several Crawlers in…
kmike updated
2 months ago
-
I propose to add some special character to the [`utils.misc.load_object`](https://github.com/scrapy/scrapy/blob/master/scrapy/utils/misc.py#L31) function's `path` argument, for example `:` to mark att…