issues
search
Boris-code
/
feapder
🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单,功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬虫解决不同场景的需求。且支持断点续爬、监控报警、浏览器渲染、海量数据去重等功能。更有功能强大的爬虫管理系统feaplat为其提供方便的部署及调度
http://feapder.com
Other
2.88k
stars
476
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
关于yield feapder.Request中的优先级问题
#205
tisoz
closed
1 year ago
2
feapder版本>1.7时,feapder.Request设置参数render=True,请求网页会报错
#204
qazasdsdqaza
opened
1 year ago
0
一个spider文件的添加任务和开始爬虫的日志能否独立开
#203
yyooovooo
opened
1 year ago
0
Update setting.py
#202
0xxfu
closed
1 year ago
0
默认日志level改成warning
#201
0xxfu
opened
1 year ago
0
通过request.get_response请求网络,没法设置日志level
#200
0xxfu
opened
1 year ago
0
playwright 1.31.1的版本,开配置开启use_stealth_js=True时,会报错
#199
demo1024
opened
1 year ago
2
[Bug]: close_browser not working
#197
BeanWei
closed
1 year ago
1
Playwright 浏览器卡死的问题
#196
pgshow
closed
1 year ago
1
mysqldb close_connection问题
#195
danerlt
closed
1 year ago
1
使用代理时诡异的连接失败的问题
#194
pgshow
closed
1 year ago
1
减少关闭等待时间,AirSpider新增统计
#193
AboutDark
closed
1 year ago
0
减少退出等待时间,彻底解决多线程退出的情况。
#192
AboutDark
closed
1 year ago
1
无任务,爬虫结束
#191
aneric16088
closed
1 year ago
1
爬虫任务已经结束了,但是end_callback要等几秒后才能收到。
#190
AboutDark
closed
1 year ago
0
GoldUserPool用户池在获取用户时,当所有用户都请求次数超限制时会卡住,应该添加日期判断
#189
wangzengshuai
closed
1 year ago
1
python3.11环境下无法使用
#188
Foreverpy
closed
1 year ago
6
浏览器渲染-Playwright - feapder官方文档|feapder-document
#187
Boris-code
opened
1 year ago
1
修复response编码错误
#186
dream2333
closed
1 year ago
0
运行 Feapder 时遇到 It looks like you are using Playwright Sync API inside the asyncio loop.
#185
pgshow
closed
1 year ago
1
兼容在链接参数中可能出现 = 的情况
#184
s0ing
closed
1 year ago
0
浏览器渲染(Selenium) - 无头浏览器模式无法正常运行?
#183
suyin-long
closed
1 year ago
1
请问支持playwright吗
#182
ffxiused
closed
1 year ago
1
test
#181
Boris-code
closed
1 year ago
0
render=True的时候,使用xhr_url_regexes会报错:RecursionError: maximum recursion depth exceeded
#180
9cij
closed
1 year ago
1
feapder解码Bug?
#179
suyin-long
closed
1 year ago
2
反馈一个 feapder Bug
#178
suyin-long
closed
1 year ago
2
feapder.pipelines.mongo_pipeline.MongoPipeline 丢失连接
#177
yuzhegan
closed
1 year ago
0
分布式环境下GoldUserPool如何控制一个账号的使用频率
#176
luoshun1
closed
1 year ago
3
How to use playwright in batchspider mode?
#175
lycanthropes
closed
1 year ago
3
修改make_batch_sql方法中对keys的取值逻辑
#174
gyco
closed
1 year ago
0
渲染模式报错:Promise was collected
#173
lanyuer
closed
1 year ago
1
1.7.9无法指定类型创建爬虫
#172
fgetwewr
closed
1 year ago
6
AttributeError: type object 'DesiredCapabilities' has no attribute 'PHANTOMJS'
#171
mndon
closed
1 year ago
1
自定义配置里面的PROXY_EXTRACT_API无效
#170
ddzyx
closed
1 year ago
0
废弃本次代理无效,重试request用的还是失效的代理ip
#169
ddzyx
opened
2 years ago
0
启动会导致CPU暴涨
#168
johnck
closed
1 year ago
1
在windows下出现了TypeError: can't pickle _thread.lock objects
#167
guyan-slh
closed
1 year ago
1
fix:处理在exception_request中返回新的Request对象没有设置parser_name属性,导致无法发送请求的问题
#166
wang-weart
closed
2 years ago
2
修复建立本地缓存代理文件夹时,os.mkdir()系统无法找到指定的路径的问题
#165
Shurelol
closed
1 year ago
0
能否实现打开本地html文件并解析的功能?
#164
iptag
closed
1 year ago
6
feapder命令行功能实现代码替换
#163
andy0andy
closed
1 year ago
0
feapder命令行功能实现代码替换
#162
andy0andy
closed
2 years ago
0
分布式爬虫如何定义爬虫间的依赖关系
#161
TestsLing
opened
2 years ago
1
chrome 的渲染遇到一个 js 卡住了整个标签页
#160
pgshow
closed
1 year ago
3
任务爬虫-TaskSpider - feapder-document
#159
Boris-code
opened
2 years ago
0
日志重复输出
#158
xihacode
closed
1 year ago
2
keep-alive和session无效,http/https连接无法复用
#157
dream2333
opened
2 years ago
1
新增读取mysql数据时,是否对值进行转化的判断
#155
gyco
closed
2 years ago
0
有什么方法主动停掉爬虫吗?
#153
ybw-github
opened
2 years ago
1
Previous
Next