Cl0udG0d / Fofa-hack

非付费会员,fofa数据采集工具
GNU General Public License v2.0
556 stars 99 forks source link

search_key #39

Closed RDPLinux closed 10 months ago

RDPLinux commented 11 months ago

[-] error:list index out of range [*] ????:0 now search key: "man"

Traceback (most recent call last): File "fofa.py", line 64, in main() File "fofa.py", line 60, in main fofa.start() File "/root/Fofa-hack/core/fofaC.py", line 511, in start self.fofaSpider(self.search_key, searchbs64, 0) File "/root/Fofa-hack/core/fofaC.py", line 329, in fofaSpider search_key_modify = self.modifySearchTimeUrl(search_key, index) File "/root/Fofa-hack/core/fofaC.py", line 431, in modifySearchTimeUrl time_first = timestamp_list[0].split(' ')[0].strip('\n').strip() IndexError: list index out of range

Any Search that gives me the same message, may you check and update, please.

RDPLinux commented 11 months ago

[] LEVEL = 1 , 初始化成功 [] 爬取延时: 3s [] 爬取关键字: "thinkphp" [] 爬取结束数量: 100 [] 输出格式为: txt [] 存储文件名: facc36ec160014e8e39a4bf2c3736e1f_1691989175.txt [] 是否开启关键字fuzz: False [] 是否开启代理: False [*] 不从文件中读取

[] 开始运行 [] 爬取页面为:https://fofa.info/result?qbase64=InRoaW5rcGhwIg== [-] error:list index out of range [] 存在数量:0 无搜索结果 [] 抓取结束,共抓取数据 0 条

Cl0udG0d commented 11 months ago

Please provide your search command and usage version

My command is

fofa-hack.exe -k thinkphp

It seems to be running smoothly

image

RDPLinux commented 11 months ago

V 2.3.6 python3 fofa.py -k "Test" --output Test

https://prnt.sc/vojpWS3KYGSk

Cl0udG0d commented 11 months ago

No output parameter is Test

Cl0udG0d commented 11 months ago

V 2.3.6 You can use

python3 fofa.py -k "Test" --output txt

RDPLinux commented 11 months ago

Hi I already use V 2.3.6 and use the command correctly, but I still have the same problem.

This problem occurred on 3 Linux servers and on Windows Server using Python 3.

https://prnt.sc/b_-Efmqp4Cyl

[-] error:list index out of range [] 存在数量:0 无搜索结果 [] 抓取结束,共抓取数据 0 条

Cl0udG0d commented 10 months ago

Is your server not within China

Cl0udG0d commented 10 months ago

I suspect it's a network issue

RDPLinux commented 10 months ago

Hi The script was working fine, then stopped working, so it's not about the server from China or not. also I installed the code in 3 Linux Servers locations, and the issue is still the same. Please test from your said maybe you can find the issue and solve it.

kufei326 commented 10 months ago

我也出现这个问题了,昨天都还好的

Cl0udG0d commented 10 months ago

我也出现这个问题了,昨天都还好的

你用的exe还是python文件,版本是多少 我这边还是没有复现这个问题

Cl0udG0d commented 10 months ago

Hi The script was working fine, then stopped working, so it's not about the server from China or not. also I installed the code in 3 Linux Servers locations, and the issue is still the same. Please test from your said maybe you can find the issue and solve it.

image

Do you have a curl tool on your server? Perhaps you can use it to troubleshoot the problem and tell me the curl results

curl https://fofa.info/result?qbase64=IlRlc3Qi

RDPLinux commented 10 months ago

https://prnt.sc/uPZ7AEIk29fz Please Check

RDPLinux commented 10 months ago

to be sure that my network has not been blocked from FOFA. This is a ping test. Working fine PING fofa.info (101.36.123.64) 56(84) bytes of data. 64 bytes from 101.36.123.64 (101.36.123.64): icmp_seq=1 ttl=39 time=167 ms 64 bytes from 101.36.123.64 (101.36.123.64): icmp_seq=2 ttl=39 time=167 ms 64 bytes from 101.36.123.64 (101.36.123.64): icmp_seq=3 ttl=39 time=167 ms 64 bytes from 101.36.123.64 (101.36.123.64): icmp_seq=4 ttl=39 time=167 ms ^C --- fofa.info ping statistics --- 4 packets transmitted, 4 received, 0% packet loss, time 3003ms rtt min/avg/max/mdev = 167.524/167.552/167.596/0.502 ms

RDPLinux commented 10 months ago

[-] Error: list index out of range I think this error is due to the script not calculating the number typed in the search, so it gets no results to download. Also, I know how your idea for coding this script is to create an account in Fofa using a temporary email, then get the active code that was sent from Fofa, then use it to download the free quota, then create another account, etc. and really it's a good idea, but If you will update the version, please add the tor option for every process for auto-reload and change the IP address to avoid being blocked because tor is free and better than Proxy .

[] LEVEL = 1 , 初始化成功 [] 爬取延时: 3s [] 爬取关键字: "index" [] 爬取结束数量: 100 [] 输出格式为: txt [] 存储文件名: 29d21d3a0b2470eea8228514d74cd213_1692267387.txt [] 是否开启关键字fuzz: False [] 是否开启代理: False [*] 不从文件中读取

[] 开始运行 [] 爬取页面为:https://fofa.info/result?qbase64=ImluZGV4Ig== [-] error:list index out of range [] 存在数量:0 无搜索结果 [] 抓取结束,共抓取数据 0 条

Cl0udG0d commented 10 months ago

[-] Error: list index out of range I think this error is due to the script not calculating the number typed in the search, so it gets no results to download. Also, I know how your idea for coding this script is to create an account in Fofa using a temporary email, then get the active code that was sent from Fofa, then use it to download the free quota, then create another account, etc. and really it's a good idea, but If you will update the version, please add the tor option for every process for auto-reload and change the IP address to avoid being blocked because tor is free and better than Proxy .

[] LEVEL = 1 , �始化�功 [] 爬�延时: 3s [] 爬�关键字: "index" [] 爬�结�数�: 100 [] 输出格�为: txt [] 存储文件�: 29d21d3a0b2470eea8228514d74cd2131692267387.txt [] 是�开�关键字fuzz: False [_] 是�开�代�: False [*] �从文件中读�

[] 开始�行 [] 爬�页�为:https://fofa.info/result?qbase64=ImluZGV4Ig== [-] error:list index out of range [] 存在数�:0 无�索结果 [] 抓�结�,共抓�数� 0 �

I'm sorry you misunderstood. The method you mentioned is not the default search method. In fact, Fofa hack uses timestamps to infinitely crawl results

Cl0udG0d commented 10 months ago

https://prnt.sc/uPZ7AEIk29fz Please Check

It seems that your IP cannot access this website address https://fofa.info/result?qbase64=IlRlc3Qi

Here are my results

image

There is still a lot of content to follow, such as

image

You can check if there are any keywords in your curl results "Certificate Signature Algorithm"

use

curl https://fofa.info/result?qbase64=IlRlc3Qi | findstr "Certificate Signature Algorithm"

or use

curl https://fofa.info/result?qbase64=IlRlc3Qi | grep "Certificate Signature Algorithm"

You can see that this is

image

RDPLinux commented 10 months ago

curl https://fofa.info/result?qbase64=IlRlc3Qi | findstr "Certificate Signature Algorithm" -bash: findstr: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 2 556k 2 15743 0 0 9466 0 0:01:00 0:00:01 0:00:59 9472 curl: (23) Failed writing body (0 != 15743)

[root@Fofa-hack]# curl https://fofa.info/result?qbase64=IlRlc3Qi | grep "Certificate Signature Algorithm" % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 556k 100 556k 0 0 143k 0 0:00:03 0:00:03 --:--:-- 143k

RDPLinux commented 10 months ago

Other Server

[root@Fofa-hack]# [root@o4lsnzky Fofa-hack]# curl https://fofa.info/result?qbase64=IlRlc3Qi | grep "Certificate Signature Algorithm" % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 556k 100 556k 0 0 160k 0 0:00:03 0:00:03 --:--:-- 160k [root@Fofa-hack]# [root@Fofa-hack]# curl https://fofa.info/result?qbase64=IlRlc3Qi | findstr "Certificate Signature Algorithm" -bash: findstr: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 2 556k 2 15743 0 0 7832 0 0:01:12 0:00:02 0:01:10 7836 curl: (23) Failed writing body (0 != 15743)

Also Windows Server

~/Desktop/Fofa-hack (main) $ curl https://fofa.info/result?qbase64=IlRlc3Qi | grep "Certificate Signature Algorithm" % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 556k 100 556k 0 0 129k 0 0:00:04 0:00:04 --:--:-- 129k

RDPLinux commented 10 months ago

Hi The issue has been solved after using a China proxy.

Cl0udG0d commented 10 months ago

Okay, it seems that Fofa's company has blocked access to overseas servers