pry0cc / axiom

The dynamic infrastructure framework for everybody! Distribute the workload of many different scanning tools with ease, including nmap, ffuf, masscan, nuclei, meg and many more!
MIT License
4k stars 622 forks source link

Parallel issues #636

Closed K4r1it0 closed 1 year ago

K4r1it0 commented 1 year ago

Does the module runs on all instances in the same time. I am using puredns with https://wordlists-cdn.assetnote.io/data/manual/best-dns-wordlist.txt on 100 target + 100 digitalocean instances its been 15 hours and it doesn't finish. this wordlist takes around 20m in my personal digitalocean VPS. So when 100 instances runs at the same time i expect them to finish in 30m at least.

[{
    "command":"echo _target_ | /home/op/go/bin/puredns bruteforce _wordlist_ _target_ -r /home/op/lists/resolvers.txt  | tee _output_/_target_",
    "ext":"txt",
    "wordlist":"/home/op/best-dns-wordlist.txt",
    "threads":"1"
}]
K4r1it0 commented 1 year ago

Update been 48+ hours

pdelteil commented 1 year ago

Hello there,

How are you running the scan?

Saludos,

Philippe Delteil

On Sun, 23 Oct 2022 at 01:08, K4r1it0 @.***> wrote:

Update been 48+ hours

— Reply to this email directly, view it on GitHub https://github.com/pry0cc/axiom/issues/636#issuecomment-1288016281, or unsubscribe https://github.com/notifications/unsubscribe-auth/AE2OS74KXWZDLKFLDHJLMZTWETI65ANCNFSM6AAAAAARL5H37I . You are receiving this because you are subscribed to this thread.Message ID: @.***>

K4r1it0 commented 1 year ago

axiom-scan hosts.txt -m pure.json -o dir and it still not finished

[{
    "command":"echo _target_ | /home/op/go/bin/puredns bruteforce _wordlist_ _target_ -r /home/op/lists/resolvers.txt  | tee _output_/_target_",
    "ext":"txt",
    "wordlist":"/home/op/best-dns-wordlist.txt",
    "threads":"1"
}]
pdelteil commented 1 year ago

Include the output of the first lines of execution. It should be puredns without the json I don't know if that will make any difference. How many selected instances do you have running?

On Sun, Oct 23, 2022, 19:23 K4r1it0 @.***> wrote:

axiom-scan hosts.txt -m pure.json -o dir and it still not finished

[{ "command":"echo target | /home/op/go/bin/puredns bruteforce wordlist target -r /home/op/lists/resolvers.txt | tee output/target", "ext":"txt", "wordlist":"/home/op/best-dns-wordlist.txt", "threads":"1" }]

— Reply to this email directly, view it on GitHub https://github.com/pry0cc/axiom/issues/636#issuecomment-1288245431, or unsubscribe https://github.com/notifications/unsubscribe-auth/AE2OS72HLUQEQ4C6W4SU6I3WEXJJJANCNFSM6AAAAAARL5H37I . You are receiving this because you commented.Message ID: @.***>

K4r1it0 commented 1 year ago

axiom

K4r1it0 commented 1 year ago

its been 48+ and the scan did not finish I am running puredns on 123 host on 100 instances using assetnote dns wordlist. it seems like the scan running only on one host.

Ps : i know that the image has 38 instance only but this is a separated scan since that i can't get the first lines of execution for the original scan that uses 100 instance because it runs on tmux

Update: i tried axiom-exec "ps -aux | grep puredns" and only 10 hosts was executing puredns and i dont know why

0xtavian commented 1 year ago

@K4r1it0 Sorry for the delay.

I am running puredns on 123 host on 100 instances using assetnote dns wordlist. it seems like the scan running only on one host.

in this case, axiom will split the input file the best it can, 77 instances would be scanning only 1 target, the other 23 instances would be scanning 2 targets

You can check each scanner by ssh-ing into the instance (axiom-ssh $name), cd to the unique scan working dir and check the input file and command. You can also attach to the tmux sessions running on the remote instances to see their progress ( the tmux session usually exits when it’s finished. So if you don’t see it. It’s probably finished )or you can just cat the stdout.log and stderr.log files in the unique scan working dir.

Update: i tried axiom-exec "ps -aux | grep puredns" and only 10 hosts was executing puredns and i dont know why

Likely because the other scans completed. You can see which scans are still running by cd into the LOCAL tmp working dir $HOME/.axiom/tmp/$module+$uid, you can ls output/ or you can diff hosts status/completed/hosts

Just to be sure, /home/op/best-dns-wordlist.txt" exists on the remote instances?

p.s. if you add —rm-when-done the instance is deleted after its job is completed.