search

tomnomnom / meg

Fetch many paths for many hosts - without killing the hosts
MIT License
1.59k stars 266 forks source link

Feature Request/Question: Accept URL's from Stdin #63

Closed pry0cc closed 4 years ago

pry0cc commented 4 years ago

Hey! I'm not sure if I'm being an idiot, but it seems like there isn't any way to accept URL's from stdin?

I was about to write my tool then I discovered meg, would it be possible to do something like: crobat -s dyson.com | httprobe | meg paths - out

Is there support for this with bash-fu or is this something I can PR for?

Thanks!

Keep up the great work :)

pry0cc commented 4 years ago

Just an update:

I found out a much better way of doing this with concurl:

 crobat -s dyson.com | httprobe | ./add_path.sh | concurl

Where add_path.sh is:

#!/bin/bash

while read line
do
  echo "$line/.env"
done < "${1:-/dev/stdin}"

It's a neat little hack I'll probably turn into a utility somewhere.

Thanks!