search

hakluke / hakrawler

Simple, fast web crawler designed for easy, quick discovery of endpoints and assets within a web application
https://hakluke.com
GNU General Public License v3.0
4.42k stars 483 forks source link

Feature request: list external urls #67

Closed azimut closed 3 years ago

azimut commented 4 years ago

List external domains url links, without needing to run it with "-scope yolo".

Reason: might be useful for second level domain takeover.

steps to reproduce:

> hakrawler -urls -depth 1 -scope yolo -url https://github.com | grep twitter
[url] https://twitter.com/github
[> hakrawler -urls -depth 1 -scope subs -url https://github.com | grep twitter
>
hakluke commented 3 years ago

It does this now