-
Is there a way to take a screenshot for a `process_spider_exception` error?
I can't figure out how to access the page object in that middleware.
-
请问是否能支持自行上传书籍的爬取?有一些上传的内容当时没做好保存现在只能在网页上看(
```bash
Traceback (most recent call last):
File "C:\Users\XQH\scoop\apps\python38\current\lib\runpy.py", line 194, in _run_module_as_main
return …
-
### Describe the bug
I'm scrapping the marvel fandom site using tasks of asyncio.
Every time that I try to get the HTML document from a URL that contains the '&' symbol I have the same issue:
For…
-
I sometimes get this error when i use scrapy-pilaywright
```
2023-03-31 09:33:35 [asyncio] ERROR: Task was destroyed but it is pending!
source_traceback: Object created at (most recent call las…
-
### Privileged issue
- [X] I'm @tiangolo or he asked me directly to create an issue here.
### Issue Content
"Why do I get the error 'greenlet_spawn has not been called' when I set sa_relationship_k…
-
Hi, I didn't find the related doc about connect with ssl in peewee-async and [the method in peewee](http://docs.peewee-orm.com/en/latest/peewee/playhouse.html?highlight=ssl#ssl-configuration) is not w…
-
Traceback (most recent call last):
File "/home/kali/Tools/xsscrapy/xsscrapy.py", line 4, in
from scrapy.cmdline import execute
File "/usr/local/lib/python3.11/dist-packages/scrapy/__init__…
-
### System info
- Playwright Version: [v1.40]
- Operating System: [ macOS 14.2.1]
- Browser: Chromium
- Other info:
### Source code
```
from playwright.async_api import async_playwright
im…
-
Hi
I am executing the Eval code on the spider data with picard using docker image
provided 777 permission to mentioned 2 directories
'make eval'
inside docker -> Install stanza package
python…
-
### Description
`scrapy.shell.inspect_response` does not work with the `asyncio` reactor when using the `ipython` shell
### Steps to Reproduce
1. Create a spider with the following contents:
…