Not all urls on Waybackmachine are grabbed

lc / gau

Fetch known URLs from AlienVault's Open Threat Exchange, the Wayback Machine, and Common Crawl.

MIT License

3.9k stars 439 forks source link

Not all urls on Waybackmachine are grabbed #30

Closed trieulieuf9 closed 3 years ago

trieulieuf9 commented 3 years ago

Hi,

First, thank for the great tools, it helps me found several bugs, including my seconds first bug too :)

I notices that a url that i can find on WaybackMachine, but cannot find it in gau output (i tried waybackurls, not found too). The sample url is from a H1 private program, i will send you an email with the sample url instead.

lc commented 3 years ago

Hi, glad you've found it useful! Can you email a sample URL to corben[at]threat.dev? Thanks!

lc commented 3 years ago

Hey @trieulieuf9,

Can you send me another sample URL again? Thanks.

trieulieuf9 commented 3 years ago

Hi, @lc

I just pull urls with gau again, this time the previously missing url is presented in gau result.

lc commented 3 years ago

Perfect!