-
您好,请问我之前已经运行了您的weibo_spider爬虫创建了一个weibo数据库,我现在也需要运行您的weibo-search,是否可以将weibo-search爬取的内容,与weibo_spider爬取的内容存在一个数据库中呢?如果可以,应该如何修改呢?
-
D:\weibo\text\weibo-search-master>scrapy crawl search -s JOBDIR=crawls/search
2022-12-16 22:42:13 [scrapy.core.scraper] ERROR: Spider error processing (referer: None)
Traceback (most recent call la…
-
File "D:\PythonPro\weibo-search-master\weibo-search-master\weibo\spiders\search.py", line 356, in parse_weibo
weibo['bid'] = sel.xpath(AttributeError: 'NoneType' object has no attribute 'split')…
-
是这样显示
```
git:2022-08-02 23:57:40 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://s.weibo.com/weibo?q=%23%E6%98%93%E7%83%8A%E5%8D%83%E7%8E%BA%E8%80%83%E7%BC%96%23®ion=cust…
-
https://github.com/Ingram7/Weibo/blob/b9ff00f1b1270d6adaa49340fa1757d6d902f15c/Weibo/spiders/weibo_spider.py#L47
-
"C:\Users\tonyx\Desktop\Weibo Crawler\comment\pythonProject2\Scripts\python.exe" C:\Users\tonyx\Downloads\weibo-search-master\weibo-search-master\weibo\spiders\search.py
进程已结束,退出代码0
-
2021-11-13 16:18:37 [scrapy.core.scraper] ERROR: Spider error processing (referer: None)
Traceback (most recent call last):
File "/home/xiao/weibo/venv/lib/python3.7/site-packages/scrapy/utils/de…
-
File "D:\weibo\weibo-search-master\weibo\spiders\search.py", line 186
def parse_by_hour(self, response):
^
IndentationError: unindent does not match any out…
-
---------------------------------------------------------------------------
ModuleNotFoundError Traceback (most recent call last)
D:\weibo-search-master\weibo-search-master\wei…
-
Traceback (most recent call last):
File "D:/weibo/spiders/search.py", line 37, in
class SearchSpider(scrapy.Spider):
File "D:/weibo/spiders/search.py", line 43, in SearchSpider
if not…
WXONE updated
3 years ago