dataabc / weibo-search

获取微博搜索结果信息,搜索即可以是微博关键词搜索,也可以是微博话题搜索
1.67k stars 369 forks source link

大佬,为什么我运行后报错呀,T T #422

Open lsw-777 opened 10 months ago

lsw-777 commented 10 months ago

D:\Desktop\爬虫\weibo-search-master>scrapy crawl search Traceback (most recent call last): File "C:\Users\lenovo\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 196, in _run_module_as_main return _run_code(code, main_globals, None, File "C:\Users\lenovo\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 86, in _run_code exec(code, run_globals) File "C:\Users\lenovo\AppData\Local\Programs\Python\Python310\Scripts\scrapy.exe__main.py", line 7, in File "C:\Users\lenovo\AppData\Local\Programs\Python\Python310\lib\site-packages\scrapy\cmdline.py", line 160, in execute cmd.crawler_process = CrawlerProcess(settings) File "C:\Users\lenovo\AppData\Local\Programs\Python\Python310\lib\site-packages\scrapy\crawler.py", line 357, in init super().init(settings) File "C:\Users\lenovo\AppData\Local\Programs\Python\Python310\lib\site-packages\scrapy\crawler.py", line 227, in init self.spider_loader = self._get_spider_loader(settings) File "C:\Users\lenovo\AppData\Local\Programs\Python\Python310\lib\site-packages\scrapy\crawler.py", line 221, in _get_spider_loader return loader_cls.from_settings(settings.frozencopy()) File "C:\Users\lenovo\AppData\Local\Programs\Python\Python310\lib\site-packages\scrapy\spiderloader.py", line 79, in from_settings return cls(settings) File "C:\Users\lenovo\AppData\Local\Programs\Python\Python310\lib\site-packages\scrapy\spiderloader.py", line 34, in init self._load_all_spiders() File "C:\Users\lenovo\AppData\Local\Programs\Python\Python310\lib\site-packages\scrapy\spiderloader.py", line 63, in _load_all_spiders for module in walk_modules(name): File "C:\Users\lenovo\AppData\Local\Programs\Python\Python310\lib\site-packages\scrapy\utils\misc.py", line 106, in walk_modules submod = import_module(fullpath) File "C:\Users\lenovo\AppData\Local\Programs\Python\Python310\lib\importlib\init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "", line 1050, in _gcd_import File "", line 1027, in _find_and_load File "", line 1006, in _find_and_load_unlocked File "", line 688, in _load_unlocked File "", line 879, in exec_module File "", line 1017, in get_code File "", line 947, in source_to_code File "", line 241, in _call_with_frames_removed File "D:\Desktop\爬虫\weibo-search-master\weibo\spiders\search.py", line 209 """以小时和直辖市/省为单位筛选""" ^^^^^^^ SyntaxError: invalid syntax

dataabc commented 10 months ago

应该是你修改了search.py且代码格式不正确,根据错误提示修改就可以。

lsw-777 commented 10 months ago

好的好的,我现在数据库表是可以建的但是录不进去数据是怎么回事呀

dataabc commented 10 months ago

有错误提示吗,或者您可以在网上搜索数据库相关问题。

lsw-777 commented 10 months ago

没有错误提示,但就是有字段,没数据,语句什么的也是按照您的代码来修改的呢

70e769dccb171f21d7ba55de237a44d c4e8134689c1f70a1d4732cda79aa43
dataabc commented 10 months ago

修改过piplines.py吗?这里有写数据库的代码。

lsw-777 commented 10 months ago

修改了,还是不行,哭了T T

lsw-777 commented 10 months ago

大佬,还有的ip获取不到是什么原因呀

dataabc commented 10 months ago

ip可能是网页格式变了,我也不确定。数据库我猜可能是数据库配置原因,您在网上搜搜。