rverton / webanalyze

Port of Wappalyzer (uncovers technologies used on websites) to automate mass scanning.
MIT License
908 stars 134 forks source link

Optionally follow redirects (default: true) #41

Closed PaulWhitingS2 closed 3 years ago

PaulWhitingS2 commented 3 years ago

This pull requests solves the issue where scanning a URL that redirects to another URL provides no results. For better or worse, the redirection is treated like a link which makes implementation easy but also does not allow crawling additional links on the redirected page.

przmv commented 3 years ago

@PaulWhitingS2 it is now possible to use custom http.Client with webanalyze, so you can configure your client to follow redirects. See #35 and #37