search

Qianlitp / crawlergo

A powerful browser crawler for web vulnerability scanners
GNU General Public License v3.0
2.85k stars 480 forks source link

fix #136

Closed HeisenbergV closed 1 year ago

HeisenbergV commented 1 year ago

改动说明

  1. 修复 --filter-mode=strict 此模式不生效bug
  2. 增加过滤接口，便于扩展过滤机制: 增加了接口fiflter.go: DoFilter(req *model.Request)，这样只需要在创建filter的时候实例化对象（NewCrawlerTask()时），无需在tab.Task()时做模式检查
redkit75 commented 1 year ago

It is not possible to filter out recurring links. Even for some .js files, it sent requests 50 times repeatedly and half of the requests returned an http 200 response.