search

hakluke / hakrawler

Simple, fast web crawler designed for easy, quick discovery of endpoints and assets within a web application
https://hakluke.com
GNU General Public License v3.0
4.41k stars 483 forks source link

Bugfix: Host Header Support #119

Closed ErikOwen closed 2 years ago

ErikOwen commented 2 years ago

Fixes #68.

This PR updates hakrawler to reference the latest colly version that has support for passing in host and other custom headers directly to the the Collector struct. It also checks to see if there is a Host header set, and if there is, then it adds that host to the list of allowed domains.

hakluke commented 2 years ago

You absolute champion! Great work

hakluke commented 2 years ago

It also updates xmlquery which was vulnerable to a DoS