xnl-h4ck3r / waymore

Find way more from the Wayback Machine, Common Crawl, Alien Vault OTX, URLScan & VirusTotal!
MIT License
1.68k stars 193 forks source link

The saved results are incorrect!!! #26

Closed muxueo closed 1 year ago

muxueo commented 1 year ago

I use a "https://otx.alienvault.com/api/v1/indicators/domain/target.com/url_list?limit=100&page=1" image Get a url, have a port 4045. But I use waymore, view result, it doesn't have a port. image

xnl-h4ck3r commented 1 year ago

Hi @muxueo Thanks for raising this issue, I'll look into it. I understand whey you won't share it here, but are you okay messaging me on Twitter with the actual domain you are using so I can see a real example? I understand if you don't want to. In the returned JSON from otx.alienvault.com, what field is the Port shown in? Is it just in the url field? Thanks Xnl

EDIT: Also, did you use any other options when callign waymore to get the data, e.g. -ns, ro anything else? As far as I can see the port is only stripped from returned URLs if it is :80 and :443 so I can't see why :4045 would not be in the list returned. I really need a genuine example to test out.

muxueo commented 1 year ago

Yes, it's a URL field. I have already sent a message on Twitter

muxueo commented 1 year ago

fix in v1.25