projectdiscovery / httpx

httpx is a fast and multi-purpose HTTP toolkit that allows running multiple probes using the retryablehttp library.
https://docs.projectdiscovery.io/tools/httpx
MIT License
7.75k stars 843 forks source link

introduce page type classifier #1924

Closed dogancanbakir closed 4 weeks ago

dogancanbakir commented 2 months ago

Closes #1923

$ go run . -u https://github.com/login -j -silent -sr | jq -r .knowledgebase.PageType
login

$ go run . -u https://lobste.rs/login -j -silent -sr | jq -r .knowledgebase.PageType
login

Note: It's not performing well atm, but it's a progress.