search

projectdiscovery / httpx

httpx is a fast and multi-purpose HTTP toolkit that allows running multiple probes using the retryablehttp library.
https://docs.projectdiscovery.io/tools/httpx
MIT License
7.71k stars 840 forks source link

[BUG] Some sites have titles that break the output #426

Closed No-Github closed 3 years ago

No-Github commented 3 years ago

httpx version:

root@ser453409893335:~# httpx -version

    __    __  __       _  __
   / /_  / /_/ /_____ | |/ /
  / __ \/ __/ __/ __ \|   /
 / / / / /_/ /_/ /_/ /   |
/_/ /_/\__/\__/ .___/_/|_|
             /_/              v1.1.3

        projectdiscovery.io

Use with caution. You are responsible for your actions.
Developers assume no liability and are not responsible for any misuse or damage.
[INF] Current Version: v1.1.3

Current Behavior:

httpx -l fofa.txt -title -content-length -status-code -silent -threads 70 -web-server -o urlive-title.txt -random-agent -follow-redirects -retries 2

http://82.146.45.230:81 [200] [13534] [Zimbra Web Client Sign In] [Apache/2.4.18 (Ubuntu)]
https://ip.zorrogo.com [200] [11788] [Zimbra 
Web Client Sign In] [cloudflare]
http://103.15.28.228 [200] [11788] [Zimbra 
Web Client Sign In] [Apache/2.4.29 (Ubuntu)]
http://103.15.29.24 [200] [11597] [Zimbra Web Client Sign In] [Apache/2.4.29 (Ubuntu)]
http://103.103.128.121 [200] [11788] [Zimbra 
Web Client Sign In] [Apache/2.4.29 (Ubuntu)]
http://160.20.145.178 [200] [11532] [Zimbra Web Client Sign In] [Apache/2.4.29 (Ubuntu)]
http://45.192.178.208 [200] [11605] [Zimbra Web Client Sign In] [Microsoft-IIS/8.5]
http://154.220.3.17 [200] [11791] [Zimbra 
Web Client Sign In] [Microsoft-IIS/8.5]
http://156.255.2.202 [200] [11791] [Zimbra 
Web Client Sign In] [Microsoft-IIS/8.5]

image

Expected Behavior:

httpx -l fofa.txt -title -content-length -status-code -silent -threads 70 -web-server -o urlive-title.txt -random-agent -follow-redirects -retries 2

http://82.146.45.230:81 [200] [13534] [Zimbra Web Client Sign In] [Apache/2.4.18 (Ubuntu)]
https://ip.zorrogo.com [200] [11788] [Zimbra Web Client Sign In] [cloudflare]
http://103.15.28.228 [200] [11788] [Zimbra Web Client Sign In] [Apache/2.4.29 (Ubuntu)]
http://103.15.29.24 [200] [11597] [Zimbra Web Client Sign In] [Apache/2.4.29 (Ubuntu)]
http://103.103.128.121 [200] [11788] [Zimbra Web Client Sign In] [Apache/2.4.29 (Ubuntu)]
http://160.20.145.178 [200] [11532] [Zimbra Web Client Sign In] [Apache/2.4.29 (Ubuntu)]
http://45.192.178.208 [200] [11605] [Zimbra Web Client Sign In] [Microsoft-IIS/8.5]
http://154.220.3.17 [200] [11791] [Zimbra Web Client Sign In] [Microsoft-IIS/8.5]
http://156.255.2.202 [200] [11791] [Zimbra Web Client Sign In] [Microsoft-IIS/8.5]

Steps To Reproduce:

root@ser453409893335:~# cat target.txt

http://82.146.45.230:81
https://ip.zorrogo.com
http://103.15.28.228
http://103.15.29.24
http://103.103.128.121
http://160.20.145.178
http://45.192.178.208
http://154.220.3.17
http://156.255.2.202

httpx -l /target.txt -title -content-length -status-code -silent -threads 70 -web-server -o urlive-title.txt -random-agent -follow-redirects -retries 2

Anything else:

ehsandeep commented 3 years ago

@No-Github see this https://github.com/projectdiscovery/httpx/discussions/430