A command-line interface (CLI) based passive URLs discovery utility. It is designed to efficiently identify known URLs of given domains by tapping into a multitude of curated online passive sources.
This feature adds a new source, waybackrobots. It extracts endpoints
marked as disallowed from robots.txt found on your target domain
and snapshotted by the Wayback Machine.
This feature adds a new source, waybackrobots. It extracts endpoints marked as disallowed from robots.txt found on your target domain and snapshotted by the Wayback Machine.