Closed garlic0x1 closed 1 year ago
Just pushed another update that adds the -i
flag for limiting the crawl to inside a path.
for example echo https://example.com/outer_path/path1 | hakrawler -i
will not crawl https://example.com/outer_path/
This is really great work, thanks garlic0x1 🙂
url.Parse
does not return an error most of the time because it treats random strings as relative URLs.