casual-silva / NewsCrawl

狠心开源企业级舆情新闻爬虫项目:支持任意数量爬虫一键运行、爬虫定时任务、爬虫批量删除;爬虫一键部署;爬虫监控可视化; 配置集群爬虫分配策略;👉 现成的docker一键部署文档已为大家踩坑
549 stars 142 forks source link

scrapy.cfg not found #4

Open dwlifutang opened 2 years ago

dwlifutang commented 2 years ago

使用系统: centos7

问题复现 1.使用auto_manage_spiders.py提示正常上传,但系统上无显示 (base) [root@localhost scrapyd_web_manager]# python auto_manage_spiders.py -dp deploy True POST Fetch: http://192.168.1.94:5000/1/deploy/upload/, data: {'folder': 'TLNewsSpider', 'project': 'TLNewsSpider', 'version': '1667234435'} 部署成功 {'folder': 'TLNewsSpider', 'project': 'TLNewsSpider', 'version': '1667234435'}

2.使用web上传数据,提示scrapy.cfg not found

Oops! Something went wrong. Fail to deploy project: scrapy.cfg not found Tip Make sure that the 'scrapy.cfg' file resides in your project directory. Details scrapy_cfg_searched_paths: ['/tmp/scrapydweb-uncompress-4xw6opqj', '/tmp/scrapydweb-uncompress-4xw6opqj/TLNewsSpider', '/tmp/scrapydweb-uncompress-4xw6opqj/TLNewsSpider/utils', '/tmp/scrapydweb-uncompress-4xw6opqj/TLNewsSpider/test', '/tmp/scrapydweb-uncompress-4xw6opqj/TLNewsSpider/package', '/tmp/scrapydweb-uncompress-4xw6opqj/TLNewsSpider/package/monitors', '/tmp/scrapydweb-uncompress-4xw6opqj/TLNewsSpider/package/rules', '/tmp/scrapydweb-uncompress-4xw6opqj/TLNewsSpider/package/database', '/tmp/scrapydweb-uncompress-4xw6opqj/TLNewsSpider/package/Kafaka', '/tmp/scrapydweb-uncompress-4xw6opqj/TLNewsSpider/script', '/tmp/scrapydweb-uncompress-4xw6opqj/TLNewsSpider/templates', '/tmp/scrapydweb-uncompress-4xw6opqj/TLNewsSpider/templates/spiders', '/tmp/scrapydweb-uncompress-4xw6opqj/TLNewsSpider/spiders']

大佬这个是啥子问题。。。

casual-silva commented 1 year ago

Fail to deploy project scrapyd部署spider项目不成功 可能是之前的安装没有弄好