-
```
Python 3.9.13
Daphne 4.0.0
Django 4.1.2
Channels 4.0.0
Scrapy 2.7.0
scrapy-playwright 0.0.22
```
My settings:
```python
DOWNLOAD_HANDLERS = {
"http": "scrapy_playwright.handler.Sc…
-
-
Right now frontera recommends setting the PARTITION_ID in a separate python settings file for each spider / worker. However when shipping out the project it would be nice to have a command line option…
-
我使用的是py3.6.1（64位） 将项目导入pycharm运行后得到以下错误
###### 第1页 ######
出现验证码
识别验证码为：1
验证码错误
识别验证码为：1
###### 第1页 ######
Traceback (most recent call last):
File "G:/coding/wenshu_spider-master/court.py", l…
-
These are the UA's of crawlers which are not detected by this library as spiders. I will continue report them here in this thread.
```
python-requests/2.18.4
Go-http-client/2.0
FeedViewer/1.0 …
-
你好，您的项目虽然说每个视频用一个线程去抓取，但是每个视频，只抓取到一部分二进制文件后，便出现了异常，有什么好的办法可以将每个视频都完整的抓取下来吗。部分异常信息如下：
```
Exception` in thread Thread-47:
Traceback (most recent call last):
File "/System/Library/Frameworks/Pyth…
-
I ran "scrapy crawl fb -a email="barackobama@gmail.com" -a password="10wnyu31" -a page="DonaldTrump" -a date="2018-01-01" -a lang="it" -o Trump.csv" at cm but it didn't work
This error : " File "/Use…
-
Currently, the weekly AllThePlaces dump contains the output from the last weekly run of each spider. However, spiders tend to be flaky. For example:
* the scraped website can temporarily be down;
…
-
```
What steps will reproduce the problem?
1. Etiquetas sin cerrar fuera de comentarios HTML.
2. Dentro de los comentarios HTML las etiquetas sin cerrar no causan error.
3. Después de la etiqueta d…
-
Hey all, this is exactly what I was looking for, but running into a few problems trying to test it out on Windows. Using the following I get the error above:
```
import scrapy
from scrapyscript i…