Random user agent - Githubissues

tomnomnom / meg

Fetch many paths for many hosts - without killing the hosts

MIT License

1.59k stars 266 forks source link

Closed ch0wn closed 4 years ago

ch0wn commented 4 years ago

Hi,

Would be nice to have an option to add a random user agent. The one sent currently is easy to identify and block (robots.txt, .htaccess).

Thanks!

daehee commented 4 years ago

Did you try using custom header option meg --header "User-Agent: foo"?

ch0wn commented 4 years ago

Didn't knew about that option, my bad. Yes, it's working that way, thanks.