search

projectdiscovery / dnsx

dnsx is a fast and multi-purpose DNS toolkit allow to run multiple DNS queries of your choice with a list of user-supplied resolvers.
https://docs.projectdiscovery.io/tools/dnsx
MIT License
2.19k stars 243 forks source link

[issue] Bug in wildcard (wd) filtering #10

Closed michael1026 closed 3 years ago

michael1026 commented 3 years ago

Describe the bug When using the -wd option for dnsx, no output is given, even if the domains are not wildcards. For example... cat yahoo.txt | dnsx -wd yahoo.com

Thousands of subdomains being sent through, but no domains returned. I've tried playing with different -wt values, but no luck there. I get plenty of results when not using the -wd flag though. I have also tried with multiple domain lists.

DNSX version Please share the version of the nuclei you are running with dnsx -version 1.0.1

Screenshot of the error or bug N/A. No error.

ehsandeep commented 3 years ago

Hi @michael1026,

Not able to reproduce this, Can you share the list you are using? 

$ wc -l yahoo.txt 
2000 yahoo.txt

$ cat yahoo.txt | dnsx -wd yahoo.com

      _             __  __
   __| | _ __   ___ \ \/ /
  / _' || '_ \ / __| \  / 
 | (_| || | | |\__ \ /  \ 
  \__,_||_| |_||___//_/\_\ v1.0.1

        projectdiscovery.io

[WRN] Use with caution. You are responsible for your actions
[WRN] Developers assume no liability and are not responsible for any misuse or damage.
104.227.142.68.aprez.ostk.prod.bf1.yahoo.com
1049833.ostk.bm2.prod.bf1.yahoo.com
121.147.139.98.aprez.ostk.prod.bf1.yahoo.com
132.240.139.98.aprez.ostk.prod.bf1.yahoo.com
13302473.ostk.bm2.prod.bf1.yahoo.com
13303307.ostk.bm2.prod.bf1.yahoo.com
13306389.ostk.bm2.prod.bf1.yahoo.com
102.143.139.98.aprez.ostk.prod.bf1.yahoo.com
104.160.139.98.aprez.ostk.prod.bf1.yahoo.com
105.138.139.98.aprez.ostk.prod.bf1.yahoo.com
1051128.ostk.bm2.prod.gq1.yahoo.com
123.183.139.98.aprez.ostk.prod.bf1.yahoo.com
132.196.139.98.aprez.ostk.prod.bf1.yahoo.com
13300180.ostk.bm2.prod.bf1.yahoo.com
100.101.139.98.aprez.ostk.prod.bf1.yahoo.com
100.202.10.106.aprez.ostk.prod.sg3.yahoo.com
106.206.137.98.aprez.ostk.prod.bf1.yahoo.com
122.66.125.188.aprez.ostk.prod.ir2.yahoo.com
132.207.137.98.aprez.ostk.prod.bf1.yahoo.com
13302496.ostk.bm2.prod.bf1.yahoo.com
13303388.ostk.bm2.prod.bf1.yahoo.com
13304117.ostk.bm2.prod.bf1.yahoo.com
134.241.139.98.aprez.ostk.prod.bf1.yahoo.com
104.171.10.106.aprez.ostk.prod.sg3.yahoo.com
121.8.12.217.aprez.ostk.prod.ir2.yahoo.com
13301787.ostk.bm2.prod.bf1.yahoo.com
101.165.10.106.aprez.ostk.prod.sg3.yahoo.com
102.142.139.98.aprez.ostk.prod.bf1.yahoo.com
115.202.10.106.aprez.ostk.prod.sg3.yahoo.com
106.159.10.106.aprez.ostk.prod.sg3.yahoo.com
114.236.139.98.aprez.ostk.prod.bf1.yahoo.com
134.183.139.98.aprez.ostk.prod.bf1.yahoo.com
100.143.139.98.aprez.ostk.prod.bf1.yahoo.com
1049834.ostk.bm2.prod.bf1.yahoo.com
121.142.139.98.aprez.ostk.prod.bf1.yahoo.com
102.160.139.98.aprez.ostk.prod.bf1.yahoo.com
1057467.ostk.bm2.prod.bf1.yahoo.com
133.197.250.63.aprez.ostk.prod.bf1.yahoo.com
134.164.10.106.aprez.ostk.prod.sg3.yahoo.com
101.146.139.98.aprez.ostk.prod.bf1.yahoo.com
102.146.139.98.aprez.ostk.prod.bf1.yahoo.com
104.137.10.106.aprez.ostk.prod.sg3.yahoo.com
105.137.10.106.aprez.ostk.prod.sg3.yahoo.com
106.179.10.106.aprez.ostk.prod.sg3.yahoo.com
115.207.137.98.aprez.ostk.prod.bf1.yahoo.com
13301665.ostk.bm2.prod.gq1.yahoo.com
101.160.139.98.aprez.ostk.prod.bf1.yahoo.com
114.178.10.106.aprez.ostk.prod.sg3.yahoo.com
115.15.12.217.aprez.ostk.prod.ir2.yahoo.com
123.8.12.217.aprez.ostk.prod.ir2.yahoo.com
132.165.10.106.aprez.ostk.prod.sg3.yahoo.com
132.66.125.188.aprez.ostk.prod.ir2.yahoo.com
13300104.ostk.bm2.prod.bf1.yahoo.com
13306162.ostk.bm2.prod.bf1.yahoo.com
13306595.ostk.bm2.prod.bf1.yahoo.com
102.164.10.106.aprez.ostk.prod.sg3.yahoo.com
106.142.139.98.aprez.ostk.prod.bf1.yahoo.com
106.160.139.98.aprez.ostk.prod.bf1.yahoo.com
125.100.139.98.aprez.ostk.prod.bf1.yahoo.com
13303095.ostk.bm2.prod.bf1.yahoo.com
13303643.ostk.bm2.prod.bf1.yahoo.com
1053262.ostk.bm2.corp.gq1.yahoo.com
124.166.137.98.aprez.ostk.prod.gq1.yahoo.com
124.66.125.188.aprez.ostk.prod.ir2.yahoo.com
13300901.ostk.bm2.prod.bf1.yahoo.com
13304742.ostk.bm2.prod.bf1.yahoo.com
13306183.ostk.bm2.prod.bf1.yahoo.com
104.178.10.106.aprez.ostk.prod.sg3.yahoo.com
1048372.ostk.bm2.prod.bf1.yahoo.com
1052661.ostk.bm2.prod.gq1.yahoo.com
1047306.ostk.bm2.prod.bf1.yahoo.com
1048937.ostk.bm2.prod.bf1.yahoo.com
13302912.ostk.bm2.prod.bf1.yahoo.com
100.142.139.98.aprez.ostk.prod.bf1.yahoo.com
106.8.12.217.aprez.ostk.prod.ir2.yahoo.com
132.15.12.217.aprez.ostk.prod.ir2.yahoo.com
133.196.139.98.aprez.ostk.prod.bf1.yahoo.com
102.182.139.98.aprez.ostk.prod.bf1.yahoo.com
121.149.139.98.aprez.ostk.prod.bf1.yahoo.com
13301533.ostk.bm2.prod.bf1.yahoo.com
13303659.ostk.bm2.prod.bf1.yahoo.com
michael1026 commented 3 years ago

Hey, so here's an example. When I run this list...

104.227.142.68.aprez.ostk.prod.bf1.yahoo.com
1049833.ostk.bm2.prod.bf1.yahoo.com
121.147.139.98.aprez.ostk.prod.bf1.yahoo.com
132.240.139.98.aprez.ostk.prod.bf1.yahoo.com
13302473.ostk.bm2.prod.bf1.yahoo.com
13303307.ostk.bm2.prod.bf1.yahoo.com
13306389.ostk.bm2.prod.bf1.yahoo.com
102.143.139.98.aprez.ostk.prod.bf1.yahoo.com
104.160.139.98.aprez.ostk.prod.bf1.yahoo.com
105.138.139.98.aprez.ostk.prod.bf1.yahoo.com
1051128.ostk.bm2.prod.gq1.yahoo.com
123.183.139.98.aprez.ostk.prod.bf1.yahoo.com
132.196.139.98.aprez.ostk.prod.bf1.yahoo.com
13300180.ostk.bm2.prod.bf1.yahoo.com
100.101.139.98.aprez.ostk.prod.bf1.yahoo.com
100.202.10.106.aprez.ostk.prod.sg3.yahoo.com
106.206.137.98.aprez.ostk.prod.bf1.yahoo.com
122.66.125.188.aprez.ostk.prod.ir2.yahoo.com
132.207.137.98.aprez.ostk.prod.bf1.yahoo.com
13302496.ostk.bm2.prod.bf1.yahoo.com
13303388.ostk.bm2.prod.bf1.yahoo.com
13304117.ostk.bm2.prod.bf1.yahoo.com
134.241.139.98.aprez.ostk.prod.bf1.yahoo.com
104.171.10.106.aprez.ostk.prod.sg3.yahoo.com
121.8.12.217.aprez.ostk.prod.ir2.yahoo.com
13301787.ostk.bm2.prod.bf1.yahoo.com
101.165.10.106.aprez.ostk.prod.sg3.yahoo.com
102.142.139.98.aprez.ostk.prod.bf1.yahoo.com
115.202.10.106.aprez.ostk.prod.sg3.yahoo.com
106.159.10.106.aprez.ostk.prod.sg3.yahoo.com
114.236.139.98.aprez.ostk.prod.bf1.yahoo.com
134.183.139.98.aprez.ostk.prod.bf1.yahoo.com
100.143.139.98.aprez.ostk.prod.bf1.yahoo.com
1049834.ostk.bm2.prod.bf1.yahoo.com
121.142.139.98.aprez.ostk.prod.bf1.yahoo.com
102.160.139.98.aprez.ostk.prod.bf1.yahoo.com
1057467.ostk.bm2.prod.bf1.yahoo.com
133.197.250.63.aprez.ostk.prod.bf1.yahoo.com
134.164.10.106.aprez.ostk.prod.sg3.yahoo.com
101.146.139.98.aprez.ostk.prod.bf1.yahoo.com
102.146.139.98.aprez.ostk.prod.bf1.yahoo.com
104.137.10.106.aprez.ostk.prod.sg3.yahoo.com
105.137.10.106.aprez.ostk.prod.sg3.yahoo.com
106.179.10.106.aprez.ostk.prod.sg3.yahoo.com
115.207.137.98.aprez.ostk.prod.bf1.yahoo.com
13301665.ostk.bm2.prod.gq1.yahoo.com
101.160.139.98.aprez.ostk.prod.bf1.yahoo.com
114.178.10.106.aprez.ostk.prod.sg3.yahoo.com
115.15.12.217.aprez.ostk.prod.ir2.yahoo.com
123.8.12.217.aprez.ostk.prod.ir2.yahoo.com
132.165.10.106.aprez.ostk.prod.sg3.yahoo.com
132.66.125.188.aprez.ostk.prod.ir2.yahoo.com
13300104.ostk.bm2.prod.bf1.yahoo.com
13306162.ostk.bm2.prod.bf1.yahoo.com
13306595.ostk.bm2.prod.bf1.yahoo.com
102.164.10.106.aprez.ostk.prod.sg3.yahoo.com
106.142.139.98.aprez.ostk.prod.bf1.yahoo.com
106.160.139.98.aprez.ostk.prod.bf1.yahoo.com
125.100.139.98.aprez.ostk.prod.bf1.yahoo.com
13303095.ostk.bm2.prod.bf1.yahoo.com
13303643.ostk.bm2.prod.bf1.yahoo.com
1053262.ostk.bm2.corp.gq1.yahoo.com
124.166.137.98.aprez.ostk.prod.gq1.yahoo.com
124.66.125.188.aprez.ostk.prod.ir2.yahoo.com
13300901.ostk.bm2.prod.bf1.yahoo.com
13304742.ostk.bm2.prod.bf1.yahoo.com
13306183.ostk.bm2.prod.bf1.yahoo.com
104.178.10.106.aprez.ostk.prod.sg3.yahoo.com
1048372.ostk.bm2.prod.bf1.yahoo.com
1052661.ostk.bm2.prod.gq1.yahoo.com
1047306.ostk.bm2.prod.bf1.yahoo.com
1048937.ostk.bm2.prod.bf1.yahoo.com
13302912.ostk.bm2.prod.bf1.yahoo.com
100.142.139.98.aprez.ostk.prod.bf1.yahoo.com
106.8.12.217.aprez.ostk.prod.ir2.yahoo.com
132.15.12.217.aprez.ostk.prod.ir2.yahoo.com
133.196.139.98.aprez.ostk.prod.bf1.yahoo.com
102.182.139.98.aprez.ostk.prod.bf1.yahoo.com
121.149.139.98.aprez.ostk.prod.bf1.yahoo.com
13301533.ostk.bm2.prod.bf1.yahoo.com
13303659.ostk.bm2.prod.bf1.yahoo.com
00000111.001dd-0-134bcbsri.http.atlas.cdn.ads.yahoo.com
00000111.001dd-0-134bcbsri.http.atlas.cdn.aue.yahoo.com
00000111.001dd-0-134bcbsri.http.atlas.cdn.bf1.yahoo.com
00000111.001dd-0-134bcbsri.http.atlas.cdn.b.yahoo.com
00000111.001dd-0-134bcbsri.http.atlas.cdn.corp.gq1.yahoo.com
00000111.001dd-0-134bcbsri.http.atlas.cdn.corp.yahoo.com
00000111.001dd-0-134bcbsri.http.atlas.cdn.data.yahoo.com
00000111.001dd-0-134bcbsri.http.atlas.cdn.go.yahoo.com
00000111.001dd-0-134bcbsri.http.atlas.cdn.gq1.yahoo.com
00000111.001dd-0-134bcbsri.http.atlas.cdn.ir2.yahoo.com
00000111.001dd-0-134bcbsri.http.atlas.cdn.m2.yahoo.com
00000111.001dd-0-134bcbsri.http.atlas.cdn.media.yahoo.com
00000111.001dd-0-134bcbsri.http.atlas.cdn.m.yahoo.com
00000111.001dd-0-134bcbsri.http.atlas.cdn.oa.yahoo.com
00000111.001dd-0-134bcbsri.http.atlas.cdn.query.yahoo.com
wyql-rw.fantasy-wallet-yql-production.wallet-k8s.omega.yahoo.com
00000111.001dd-0-134bcbsri.http.atlas.cdn.vip.bf1.yahoo.com
00000111.001dd-0-134bcbsri.http.atlas.cdn.windows.yahoo.com
00000111.001dd-0-134bcbsri.http.atlas.cdn.xobni.yahoo.com
00000111.001dd-0-134bcbsri.http.atlas.cdn.yahoo.com
00000111.001dd-0-134bcbsri.http.atlas.cdn.yql.yahoo.com
00001.salesforce-communities.repair-search-cdn.t.0-134kohanovski.http.atlas.cdn.yahoo.com
000184.ostk.bm2.prod.ir2.yahoo.com
000191.ostk.bm2.prod.ir2.yahoo.com
000195.ostk.bm2.prod.ir2.yahoo.com
000240.ostk.bm2.prod.ir2.yahoo.com
000241.ostk.bm2.prod.ir2.yahoo.com
000242.ostk.bm2.prod.ir2.yahoo.com
000245.ostk.bm2.prod.ir2.yahoo.com
000246.ostk.bm2.prod.ir2.yahoo.com
000248.ostk.bm2.prod.ir2.yahoo.com
000249.ostk.bm2.prod.ir2.yahoo.com
000252.ostk.bm2.prod.ir2.yahoo.com
000254.ostk.bm2.prod.ir2.yahoo.com
000255.ostk.bm2.prod.ir2.yahoo.com
000259.ostk.bm2.prod.ir2.yahoo.com
000269.ostk.bm2.prod.ir2.yahoo.com
000280.ostk.bm2.prod.ir2.yahoo.com
000283.ostk.bm2.prod.ir2.yahoo.com
000286.ostk.bm2.prod.ir2.yahoo.com
000288.ostk.bm2.prod.ir2.yahoo.com
000289.ostk.bm2.prod.ir2.yahoo.com
000291.ostk.bm2.prod.ir2.yahoo.com
000292.ostk.bm2.prod.ir2.yahoo.com
000293.ostk.bm2.prod.ir2.yahoo.com
000297.ostk.bm2.prod.ir2.yahoo.com
000299.ostk.bm2.prod.ir2.yahoo.com
000306.ostk.bm2.prod.ir2.yahoo.com
000314.ostk.bm2.prod.ir2.yahoo.com
000648.ostk.bm2.prod.ir2.yahoo.com
000654.ostk.bm2.prod.ir2.yahoo.com
000705.ostk.bm2.prod.ir2.yahoo.com
000710.ostk.bm2.prod.ir2.yahoo.com
000715.ostk.bm2.prod.ir2.yahoo.com
000725.ostk.bm2.prod.ir2.yahoo.com
000733.ostk.bm2.prod.ir2.yahoo.com
000741.ostk.bm2.prod.ir2.yahoo.com
000748.ostk.bm2.prod.ir2.yahoo.com
000750.ostk.bm2.prod.ir2.yahoo.com
000753.ostk.bm2.prod.ir2.yahoo.com
000759.ostk.bm2.prod.ir2.yahoo.com
000764.ostk.bm2.prod.ir2.yahoo.com
000765.ostk.bm2.prod.ir2.yahoo.com
000801.ostk.bm2.prod.ir2.yahoo.com
000803.ostk.bm2.prod.ir2.yahoo.com
000805.ostk.bm2.prod.ir2.yahoo.com
000807.ostk.bm2.prod.ir2.yahoo.com
000808.ostk.bm2.prod.ir2.yahoo.com
000846.ostk.bm2.prod.ir2.yahoo.com
000852.ostk.bm2.prod.ir2.yahoo.com
000965.ostk.bm2.prod.ir2.yahoo.com
000973.ostk.bm2.prod.ir2.yahoo.com
000974.ostk.bm2.prod.ir2.yahoo.com
000979.ostk.bm2.prod.ir2.yahoo.com
001158.ostk.bm2.prod.ir2.yahoo.com
001159.ostk.bm2.prod.ir2.yahoo.com
001160.ostk.bm2.prod.ir2.yahoo.com
001161.ostk.bm2.prod.ir2.yahoo.com
001162.ostk.bm2.prod.ir2.yahoo.com
001164.ostk.bm2.prod.ir2.yahoo.com
001165.ostk.bm2.prod.ir2.yahoo.com
001166.ostk.bm2.prod.ir2.yahoo.com
001167.ostk.bm2.prod.ir2.yahoo.com
001168.ostk.bm2.prod.ir2.yahoo.com
001169.ostk.bm2.prod.ir2.yahoo.com
001170.ostk.bm2.prod.ir2.yahoo.com
001171.ostk.bm2.prod.ir2.yahoo.com
001173.ostk.bm2.prod.ir2.yahoo.com
001175.ostk.bm2.prod.ir2.yahoo.com
001177.ostk.bm2.prod.ir2.yahoo.com
001178.ostk.bm2.prod.ir2.yahoo.com
001179.ostk.bm2.prod.ir2.yahoo.com
001180.ostk.bm2.prod.ir2.yahoo.com
001181.ostk.bm2.prod.ir2.yahoo.com
001182.ostk.bm2.prod.ir2.yahoo.com
001183.ostk.bm2.prod.ir2.yahoo.com
001184.ostk.bm2.prod.ir2.yahoo.com
001186.ostk.bm2.prod.ir2.yahoo.com
001187.ostk.bm2.prod.ir2.yahoo.com
001188.ostk.bm2.prod.ir2.yahoo.com
001190.ostk.bm2.prod.ir2.yahoo.com
001193.ostk.bm2.prod.ir2.yahoo.com
001194.ostk.bm2.prod.ir2.yahoo.com
001195.ostk.bm2.prod.ir2.yahoo.com
001197.ostk.bm2.prod.ir2.yahoo.com
001198.ostk.bm2.prod.ir2.yahoo.com
001199.ostk.bm2.prod.ir2.yahoo.com
001202.ostk.bm2.prod.ir2.yahoo.com
001204.ostk.bm2.prod.ir2.yahoo.com
002223.ostk.bm2.prod.ir2.yahoo.com
002224.ostk.bm2.prod.ir2.yahoo.com
002229.ostk.bm2.prod.ir2.yahoo.com
002230.ostk.bm2.prod.ir2.yahoo.com
002237.ostk.bm2.prod.ir2.yahoo.com
002253.ostk.bm2.prod.ir2.yahoo.com
002254.ostk.bm2.prod.ir2.yahoo.com
002257.ostk.bm1.prod.ir2.yahoo.com
002258.ostk.bm2.prod.ir2.yahoo.com
002280.ostk.bm2.prod.ir2.yahoo.com
002293.ostk.bm2.prod.ir2.yahoo.com
002296.ostk.bm2.prod.ir2.yahoo.com
002313.ostk.bm2.prod.ir2.yahoo.com
002314.ostk.bm2.prod.ir2.yahoo.com
002315.ostk.bm1.prod.ir2.yahoo.com
002316.ostk.bm1.prod.ir2.yahoo.com
002317.ostk.bm2.prod.ir2.yahoo.com
002321.ostk.bm2.prod.ir2.yahoo.com
002324.ostk.bm2.prod.ir2.yahoo.com
002327.ostk.bm2.prod.ir2.yahoo.com
002335.ostk.bm2.prod.ir2.yahoo.com
002355.ostk.bm2.prod.ir2.yahoo.com
002356.ostk.bm2.prod.ir2.yahoo.com
002361.ostk.bm2.prod.ir2.yahoo.com
002367.ostk.bm2.prod.ir2.yahoo.com
002474.ostk.bm2.prod.ir2.yahoo.com
002476.ostk.bm2.prod.ir2.yahoo.com
002479.ostk.bm2.prod.ir2.yahoo.com
002.corp.gq1.yahoo.com
004059.ostk.bm2.prod.ir2.yahoo.com
004060.ostk.bm2.prod.ir2.yahoo.com
004063.ostk.bm2.prod.ir2.yahoo.com
0-0.latam.corp.yahoo.com
0124.ads.yahoo.com
0124.aue.yahoo.com
0124.bf1.yahoo.com
0124.b.yahoo.com
0124.corp.gq1.yahoo.com
0124.corp.yahoo.com
0124.data.yahoo.com
0124.go.yahoo.com
0124.gq1.yahoo.com
0124.ir2.yahoo.com
0124.m2.yahoo.com
0124.media.yahoo.com
0124.m.yahoo.com
0124.oa.yahoo.com
0124.query.yahoo.com
0124.vip.bf1.yahoo.com
0124.windows.yahoo.com
0124.xobni.yahoo.com
0124.yahoo.com
0124.yql.yahoo.com
0128815074.site.ads.yahoo.com
0128815074.site.aue.yahoo.com
0128815074.site.bf1.yahoo.com
0128815074.site.b.yahoo.com
0128815074.site.corp.gq1.yahoo.com
0128815074.site.corp.yahoo.com
0128815074.site.data.yahoo.com
0128815074.site.go.yahoo.com
0128815074.site.gq1.yahoo.com
0128815074.site.ir2.yahoo.com
0128815074.site.m2.yahoo.com
0128815074.site.media.yahoo.com
0128815074.site.m.yahoo.com
0128815074.site.oa.yahoo.com
0128815074.site.query.yahoo.com
0128815074.site.vip.bf1.yahoo.com
0128815074.site.windows.yahoo.com
0128815074.site.xobni.yahoo.com
0128815074.site.yql.yahoo.com
0130.ads.yahoo.com
0130.aue.yahoo.com
0130.bf1.yahoo.com
0130.b.yahoo.com
0130.corp.gq1.yahoo.com
0130.corp.yahoo.com
0130.data.yahoo.com
0130.go.yahoo.com
0130.gq1.yahoo.com
www.yahoo.com
news.yahoo.com
gq1.yahoo.com
bf1.yahoo.com
corp.yahoo.com

I get the following output...

cat temp | dnsx -wd yahoo.com

      _             __  __
   __| | _ __   ___ \ \/ /
  / _' || '_ \ / __| \  / 
 | (_| || | | |\__ \ /  \ 
  \__,_||_| |_||___//_/\_\ v1.0.1

        projectdiscovery.io

[WRN] Use with caution. You are responsible for your actions
[WRN] Developers assume no liability and are not responsible for any misuse or damage.
0-0.latam.corp.yahoo.com

Now, I know that's not the only non-wildcard resolvable domain in this list...

ehsandeep commented 3 years ago

Hi @michael1026, I can confirm something is wrong with wd flag and we will review/fix this.

ehsandeep commented 3 years ago

Hi @michael1026,

Can you please confirm if you running this locally or over VPS?

michael1026 commented 3 years ago

Hi @team-projectdiscovery

I have the issue both locally and on a VPS.

Mzack9999 commented 3 years ago

This will be done in #34