search

tomnomnom / meg

Fetch many paths for many hosts - without killing the hosts
MIT License
1.59k stars 266 forks source link

Getting request failed: unsupported protocol scheme error. #65

Open urakesh661 opened 4 years ago

urakesh661 commented 4 years ago

Hi,

I am getting request failed: unsupported protocol scheme error for all the hosts even though they are alive and resolve when accessed through browser.

Error :

request failed: Get sadsa.test.com*: unsupported protocol scheme ""

Can you please suggest.

Thanks

giany commented 4 years ago

Probably you don't have the scheme properly set.

storenth commented 4 years ago

@giany provide with example please, because I got the same issue too.

storenth commented 4 years ago

I think we need to use httprobe first to construct hostFiles with http/https Suggest to close the issue

m0nk3y-s3c commented 4 years ago

Same issue here. I have a list of alive hosts with both http https schems. and i'm getting the same error. request failed: Get alive.subdomain.com/: unsupported protocol scheme ""

Thanks

rajeshk28 commented 4 years ago

Same issue here. I have used httprobe which will have http and https but and i'm getting the same error. request failed: Get "/robots.txt": unsupported protocol scheme "" request failed: Get "": unsupported protocol scheme ""

Any fix here? seems to be many users are reporting

junnlikestea commented 4 years ago

I had the same error on Void Linux. I changed the hosts.txt,paths.txt to hosts and paths without the extension. This fixed the problem for me.

mhassani97 commented 2 years ago

you can use this bash script

for domain in $(cat hosts | httpx); do meg -concurrency 20 /robots.txt  "http://$domain" ; done;

You Should Install httpx Also . (Optional)