-
E:\weibo-search-master>scrapy crawl search
Traceback (most recent call last):
File "e:\anaconda\lib\runpy.py", line 193, in _run_module_as_main
"__main__", mod_spec)
File "e:\anaconda\lib\…
-
/Users/wangbowen/PycharmProjects/Taobao_Spider-master/taobao_spider/pipelines.py:3: ScrapyDeprecationWarning: Module `scrapy.conf` is deprecated, use `crawler.settings` attribute instead
from scrap…
-
It would be great if a plugin like https://github.com/scrapy-plugins/scrapy-playwright did not had to force you to drive all requests through its download handlers, and instead you could drive certain…
-
Traceback (most recent call last):
File "D:\anoconda\envs\python36\lib\runpy.py", line 193, in _run_module_as_main
"__main__", mod_spec) …
-
[root@localhost woaidu_crawler]# scrapy crawl woaidu
Unhandled error in Deferred:
Unhandled Error
Traceback (most recent call last):
File "/usr/lib64/python2.7/site-packages/scrapy/commands/crawl.py…
-
`Caplog` start capturing, but in a specific place capturing is stopped.
It reproduces in one test and does not reproduce in the rest.
Additional I need `caplog.set_level('DEBUG')` for this test (spe…
-
Hi,
I am trying to run Frontera with Kafka as Message bus.
Ubuntu 16.04 LTS
Python 2.7.11
Frontera 0.5.1.1
I placed `BACKEND = 'frontera.contrib.backends.remote.kafka.KafkaOverusedBackend' in my sp…
-
我使用的是windows 7 +py3.7
F:\aox_proxy_pool\proxy_pool>scrapy crawl xici
2019-07-14 08:17:05,617 - log.py[line:146] - INFO: Scrapy 1.6.0 started (bot: proxy_pool)
2019-07-14 08:17:05 [scrapy.utils.log]…
-
Hello, I followed quick start tutorial. Turned on db worker and strategy worker. Then I turned on scrapy using `scrapy crawl general -L INFO -s FRONTERA_SETTINGS=frontier.spider_settings -s SEEDS_SOUR…
-
```
2021-02-26 12:11:22 [scrapy.utils.log] INFO: Scrapy 2.4.1 started (bot: counselor)
2021-02-26 12:11:22 [scrapy.utils.log] INFO: Versions: lxml 4.5.0.0, libxml2 2.9.10, cssselect 1.1.0, parsel 1.…