For certain scopes, GAU can yield massive lists of results (>1M or more). When checking liveness of these results, they should be parsed and filtered to prevent hogging CPU time on checking the liveness of multiple parameters on the same endpoint.
Approach:
Run GAU
Merge with GoSpider list
Strip ALL params, store unique endpoints ONLY into a separate file
Run HTTPX on said endpoints to identify liveness
Grep the original list (w/ params) with the live endpoints, filter on unique params
Run GF to identity interesting parameters (do not HTTPX for each GF list)
For certain scopes, GAU can yield massive lists of results (>1M or more). When checking liveness of these results, they should be parsed and filtered to prevent hogging CPU time on checking the liveness of multiple parameters on the same endpoint.
Approach: