issues
search
code4craft
/
webmagic
A scalable web crawler framework for Java.
http://webmagic.io/
Apache License 2.0
11.37k
stars
4.18k
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
[Snyk] Security upgrade net.sourceforge.htmlcleaner:htmlcleaner from 2.26 to 2.29
#1126
code4craft
closed
1 year ago
0
WebMagic Extension version 0.9.0 has CVE-2023-2976 vulnerability
#1125
JackLinkai
opened
1 year ago
0
HttpClientDownloader download error
#1124
mayn7z
closed
1 year ago
1
java.lang.OutOfMemoryError: Java heap space
#1123
meikey
opened
1 year ago
1
There's a code injection vulnerability of `us.codecraft.webmagic.downloader.PhantomJSDownloader`
#1122
LetianYuan
opened
1 year ago
0
[Snyk] Security upgrade org.seleniumhq.selenium:selenium-java from 3.141.59 to 4.0.0
#1121
code4craft
opened
1 year ago
0
当使用代理的时候,如果链接代理超时,最后使用Lister监听状态会被算进成功里面,而不是失败!
#1120
konglquan
opened
1 year ago
0
[Snyk] Security upgrade com.google.guava:guava from 31.1-jre to 32.0.0-jre
#1119
code4craft
closed
1 year ago
1
如何让多个spider顺序执行
#1118
getideas
opened
1 year ago
1
The domain webmagic.io has expired
#1116
x6770
closed
1 year ago
1
xpath匹配标签使用或后得到的结果集不是按顺序出现
#1115
wanygan83
opened
1 year ago
0
[Snyk] Security upgrade com.jayway.jsonpath:json-path from 2.7.0 to 2.8.0
#1114
snyk-bot
closed
1 year ago
0
爬Twitter遇到JavaScript 不可用问题。
#1113
wayss000
opened
1 year ago
1
Https绕过host检查
#1112
Tanky-Zhang
closed
1 year ago
1
webmagic0.75,0.8.0 RedisScheduler无法使用
#1111
Bertluo
opened
1 year ago
1
想要获取到最后一次重定向到的最终url
#1110
keatonLiu
opened
1 year ago
0
No appropriate protocol (protocol is disabled or cipher suites are inappropriate)
#1109
ChenSino
closed
1 year ago
1
向 webmagic-saxon 组件提供若干新 API,更优雅更灵活更强大
#1108
hooyantsing
closed
1 year ago
0
修复 HtmlCleaner 无法正常解析 tr 和 td 标签的问题
#1107
hooyantsing
closed
1 year ago
0
Can Playwright be supported
#1106
holmofy
opened
1 year ago
1
请求支持JQuery遍历API
#1105
w3l7
opened
1 year ago
0
待爬取的链接数正常,但爬取结束后的结果数和链接数不一致
#1104
w3l7
closed
1 year ago
5
可不可以和scrapy一样,对每个url定义不同的请求方式和参数等
#1103
keatonLiu
closed
1 year ago
0
如何在PageProcessor的process里面实现点击操作?
#1102
Mr-LiuDC
opened
1 year ago
1
使用setCharSet()后无法自动推测网页编码,导致网页乱码
#1101
keatonLiu
closed
1 year ago
6
有微信群吗?
#1100
byedo
opened
1 year ago
1
建议addTargetRequests方法支持所有Iterable<String>
#1099
keatonLiu
closed
1 year ago
0
Integrate URLFrontier as a backend for URL storage
#1098
jnioche
opened
1 year ago
0
javax.net.ssl.SSLHandshakeException: Received fatal alert: protocol_version
#1097
keatonLiu
closed
1 year ago
4
某些情况下爬虫会莫名其妙卡住不动,但状态是Running
#1096
keatonLiu
closed
1 year ago
3
fix(sec): upgrade com.fasterxml.jackson.core:jackson-databind to 2.14.0-rc1
#1095
pen4
closed
1 year ago
1
HttpClientDownloader不要捕获错误而是把错误抛出来
#1094
keatonLiu
opened
1 year ago
7
Processor中使用page.putField()保存对象数组,数据量较大时,没进Pipeline里
#1093
Golne
closed
1 year ago
1
CountableThreadPool 的意义何在
#1092
MaLuxray
opened
1 year ago
0
修改WebDriverPool源码指定ChromeOptions出现org.openqa.selenium.chrome.ChromeOptions.addArguments([Ljava/lang/String;)Lorg/openqa/selenium/chrome/ChromeOptions;
#1091
694475668
opened
1 year ago
3
core包与springboot冲突
#1090
MaLuxray
closed
1 year ago
1
[Snyk] Security upgrade com.fasterxml.jackson.core:jackson-databind from 2.13.4 to 2.13.4.2
#1089
code4craft
closed
1 year ago
0
[Snyk] Security upgrade us.codecraft:xsoup from 0.3.4 to 0.3.6
#1088
snyk-bot
closed
1 year ago
0
[Snyk] Security upgrade com.fasterxml.jackson.core:jackson-databind from 2.13.2.1 to 2.13.4
#1087
snyk-bot
closed
1 year ago
0
Enhance Jsoup could parse tr td tag directly
#1086
vioao
closed
1 year ago
0
Common downloader error process
#1085
vioao
closed
1 year ago
0
Common the downloader status process and pass error information when …
#1084
vioao
closed
1 year ago
0
Revert "Common the downloader status process and pass error information when …"
#1083
sutra
closed
1 year ago
0
Common the downloader status process and pass error information when …
#1082
vioao
closed
1 year ago
2
downloader 设置 proxy 与 site 设置 proxy 有区别吗?
#1081
nesteiner
opened
1 year ago
1
downloader 设置 proxy 与 site 设置 proxy 有区别吗?
#1080
nesteiner
opened
1 year ago
0
使用代理IP抓取,报http请求 432错误,问题已修复,请改源代码
#1079
song51930
closed
1 year ago
2
下载错误的页面可以再重新放回任务队列吗?为什么errorPage统计出的错误页面数一直都没变
#1078
patience00
opened
1 year ago
1
Cannot compile project
#1077
alexandrujecan
closed
2 years ago
4
pojo如何动态匹配
#1076
cyb-start
opened
2 years ago
0
Previous
Next