Qianlitp / crawlergo

A powerful browser crawler for web vulnerability scanners
GNU General Public License v3.0
2.85k stars 480 forks source link

Navigate timeout #135

Closed redkit75 closed 1 year ago

redkit75 commented 1 year ago

fixed

HeisenbergV commented 1 year ago

https://github.com/Qianlitp/crawlergo/issues/105#issuecomment-1374358617

cause:

//intercept_request.go

func (tab *Tab) InterceptRequest(v *fetch.EventRequestPaused) {
         // .....
    // 静态资源 全部阻断
    // https://github.com/Qianlitp/crawlergo/issues/106
    if config.StaticSuffixSet.Contains(url.FileExt()) {
        _ = fetch.FailRequest(v.RequestID, network.ErrorReasonBlockedByClient).Do(ctx)
        req.Source = config.FromStaticRes
        tab.AddResultRequest(req)
        return
    }
       //...