-
当很多爬虫脚本 python3 test/xxx.py
python3 test/xxx1.py
python3 test/xxx1.py
要新建三次爬虫,只是目录不同,但是在一个项目中,是不是要配置三次git提交,拉下来是三套代码,是否可优化选择已经配置过的git文件,选择项目…
-
-
**Bug 描述**
next.crawlab.cn/zh/guide/installation/docker.html#%E5%8D%95%E8%8A%82%E7%82%B9%E9%83%A8%E7%BD%B2)
**复现步骤**
该 Bug 复现步骤如下
1单节点部署
2上传爬虫文件
3启动爬虫(命令是python3 run.py)
4启动失败了,ModuleNotFound…
-
We currently use pypostal to parse addresses within our crawlers (https://github.com/openvenues/pypostal). This software requires some C code to be installed. After installed the pre-requisites, the…
-
**Bug 描述**
通过 web 界面安装 nodejs 依赖不成功。
**复现步骤**
该 Bug 复现步骤如下
1. 进入 爬虫 -> 依赖 页面,点击 “安装”,界面提示已成功,但是依赖并没有安装。
![image](https://github.com/crawlab-team/crawlab/assets/1478284/d3160f02-3c95-4b02-841e-d…
-
Hey There -
I'm evaluating using Crawlab for our crawlers, but came across an issue trying to deploy our first crawler using the framework. Our existing Python spider navigates to the site we wa…
-
**Describe the bug**
Certain tasks show !Abnormal status after running them for few hours but there aren't any errors shown either in task logs or in docker logs. Few hours later they tend to change …
-
目前运行报错:
[+] Running 4/4
✔ Network crawlab_default Created 0.1…
-
**Describe the bug**
Crawlab is returning an error "ModuleNotFoundError" when attempting to run a spider using Playwright
![image](https://github.com/crawlab-team/crawlab/assets/145069239/e03e9f9a…
-
# 每日安全资讯(2023-08-21)
- SecWiki News
- [ ] [SecWiki News 2023-08-20 Review](http://www.sec-wiki.com/?2023-08-20)
- unSafe.sh - 不安全
- [ ] [俄罗斯首颗月球探测器Luna-25坠毁在月球 没能实现赶超印度的愿望](https://buaq.net/go-17…