search

hakluke / hakrawler

Simple, fast web crawler designed for easy, quick discovery of endpoints and assets within a web application
https://hakluke.com
GNU General Public License v3.0
4.49k stars 497 forks source link

Added support for (http) proxy server and command line option -proxy. #83

Closed pjaakko closed 3 years ago

pjaakko commented 3 years ago

Added support to proxy servers (like Burb). Code simply sets proxy server to colly.

There is another PR open regarding proxy support. The reason of duplicate PR is that the other PR seems to support only socks5-proxies and contains unnecessary whitespace changes.

hakluke commented 3 years ago

Hey! This is really great, but not all requests go through colly. I believe that the way this has been implemented only works for the colly requests? It might be best if all requests go through the proxy.

hakluke commented 3 years ago

hey sorry I've rewritten the whole thing now!