search

projectdiscovery / httpx

httpx is a fast and multi-purpose HTTP toolkit that allows running multiple probes using the retryablehttp library.
https://docs.projectdiscovery.io/tools/httpx
MIT License
7.55k stars 823 forks source link

headless chrome wappalyzer detection via js #959

Open cyberlixio opened 1 year ago

cyberlixio commented 1 year ago

Please describe your feature request:

Currently, httpx does not take advantage of chromium-based wappalyzer detection with the -tech-detect flag, so httpx is missing a lot of technologies when relying solely on fingerprint-based detection.

Describe the use case of this feature:

Introducing browser-based wappalyzer detection will allow us to not only rely on fingerprint-based detection but also Javascript-based detection which will result in detecting more technologies stacks.

What you could do to see if it's something you would like to implement is to compile this rust crate https://github.com/iustin24/wappalyzer which uses browser-based wappaylzer detection and run it against a bunch of hosts then compare the results with httpx and see if it found more technologies.

Hopefully, this is something you might consider, I've been really wanting a tool that can do what I described.

Regards, Blake

localhost-MouhannadlrX commented 1 year ago

realy a lot of technologies like CMSs and js library missed using '-tech-detect' , I hope you will enhance that soon

ethicalhackingplayground commented 1 year ago

I've written a basic version of httpx in rust and you can see the difference in technologies using headless chrome.

image