search

Qianlitp / crawlergo

A powerful browser crawler for web vulnerability scanners
GNU General Public License v3.0
2.85k stars 480 forks source link

Duplicate Requests #144

Open redkit75 opened 1 year ago

redkit75 commented 1 year ago

No matter what filter is used, too many identical URL and body requests are being sent. Also, it's ridiculous that it's sending 40-50 requests to the URL of some .js files.

HeisenbergV commented 1 year ago

Can you provide an example or running log

Miracles666 commented 4 months ago

No matter what filter is used, too many identical URL and body requests are being sent. Also, it's ridiculous that it's sending 40-50 requests to the URL of some .js files.无论使用什么过滤器，都会发送太多相同的 URL 和正文请求。此外，它向某些 .js 文件的 URL 发送 40-50 个请求是荒谬的。

因为每个浏览器访问某个链接都会触发相应的JS 这是无法避免的，除非有种比较好的本地缓存方式把对应的返回包存储起来，请求重复JS时返回。