子域名只用了11秒，随后未进行下一步信息搜集以及漏洞扫描

[kesonn]

[kesonn]

端口都是空的

[ice-doom]

这里结束时间表示执行到当前状态的时间，状态表示当前执行的任务状态。像图中表示当前正在执行子域名收集还未完成，结束时间表示执行到子域名收集的上一个任务的结束时间。是正常的

[kesonn]

请问哪里可以看到具体日志进度？

[ice-doom]

可以进去容器查看下日志，docker exec -it eyejo_worker tail -50 celery.log

[kesonn]

[kesonn]

看到官方还没修复这个bug？ https://github.com/shmilylty/OneForAll/issues/201

[ice-doom]

这个等修复后，就更新一下。另一个bug，是由于进行域名解析不出IP的目标导致获取的时候为None，需要调整代码。

[ice-doom]

目前已知的bug已解决，请重新拉取镜像和git

[kesonn]

4天过去了，还是在子域名搜集，重新搭建一个可以修复这个问题吗

[ice-doom]

可以尝试重新拉取镜像和git，再启动环境添加目标。本地测试过，这种状况是可以正常执行完成。 你子域名收集的数量有多少，1个域名基本上几分钟能收集完成。如果超过半天/一天卡住在同一个状态下可以查看日志是在是否正常运行。

[kesonn]

发现一天过去了，还是在同一个状态。已经是重新拉取镜像和git，重新创建容器

[ice-doom]

提供下日志记录、输入的子域名收集数量

[kesonn]

         ___             _ _ 

| |__ | | | {v0.4.3 #dev} | . | | -| | . | | .'| | | |__||||_| ||| |,||| git.io/fjHT1

OneForAll is under development, please update before each use! [2021-05-27 12:48:27,408: WARNING/ForkPoolWorker-2] [] Starting OneForAll @ 2021-05-27 12:48:27 [2021-05-27 12:48:29,942: WARNING/ForkPoolWorker-2] Exception in thread [2021-05-27 12:48:29,942: WARNING/ForkPoolWorker-2] netcraft [2021-05-27 12:48:29,942: WARNING/ForkPoolWorker-2] : [2021-05-27 12:48:29,942: WARNING/ForkPoolWorker-2] Traceback (most recent call last): [2021-05-27 12:48:29,942: WARNING/ForkPoolWorker-2] File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner [2021-05-27 12:48:29,944: WARNING/ForkPoolWorker-2] self.run() [2021-05-27 12:48:29,944: WARNING/ForkPoolWorker-2] File "/usr/lib/python3.8/threading.py", line 870, in run [2021-05-27 12:48:29,944: WARNING/ForkPoolWorker-2] self._target(self._args, self._kwargs) [2021-05-27 12:48:29,944: WARNING/ForkPoolWorker-2] File "/root/eyejo/plugin/OneForAll/modules/datasets/netcraft.py", line 80, in run [2021-05-27 12:48:29,944: WARNING/ForkPoolWorker-2] query.run() [2021-05-27 12:48:29,944: WARNING/ForkPoolWorker-2] File "/root/eyejo/plugin/OneForAll/modules/datasets/netcraft.py", line 66, in run [2021-05-27 12:48:29,945: WARNING/ForkPoolWorker-2] self.query() [2021-05-27 12:48:29,945: WARNING/ForkPoolWorker-2] File "/root/eyejo/plugin/OneForAll/modules/datasets/netcraft.py", line 39, in query [2021-05-27 12:48:29,945: WARNING/ForkPoolWorker-2] if not self.bypass_verification(): [2021-05-27 12:48:29,945: WARNING/ForkPoolWorker-2] File "/root/eyejo/plugin/OneForAll/modules/datasets/netcraft.py", line 29, in bypass_verification [2021-05-27 12:48:29,945: WARNING/ForkPoolWorker-2] cookie_value = self.cookie['netcraft_js_verification_challenge'] [2021-05-27 12:48:29,945: WARNING/ForkPoolWorker-2] File "/usr/local/lib/python3.8/dist-packages/requests/cookies.py", line 328, in getitem [2021-05-27 12:48:29,945: WARNING/ForkPoolWorker-2] return self._find_no_duplicates(name) [2021-05-27 12:48:29,945: WARNING/ForkPoolWorker-2] File "/usr/local/lib/python3.8/dist-packages/requests/cookies.py", line 399, in _find_no_duplicates [2021-05-27 12:48:29,946: WARNING/ForkPoolWorker-2] raise KeyError('name=%r, domain=%r, path=%r' % (name, domain, path)) [2021-05-27 12:48:29,946: WARNING/ForkPoolWorker-2] KeyError [2021-05-27 12:48:29,946: WARNING/ForkPoolWorker-2] : [2021-05-27 12:48:29,946: WARNING/ForkPoolWorker-2] "name='netcraft_js_verification_challenge', domain=None, path=None" [2021-05-27 13:02:05,728: ERROR/ForkPoolWorker-2] Task EyeJoTask[f07efda4-aef6-4a88-bcc6-3a191a475a70] raised unexpected: KeyError('ip') Traceback (most recent call last): File "/usr/local/lib/python3.8/dist-packages/celery/app/trace.py", line 405, in trace_task R = retval = fun(*args, *kwargs) File "/usr/local/lib/python3.8/dist-packages/celery/app/trace.py", line 697, in __protected_call__ return self.run(args, kwargs) File "/root/eyejo/EyeJo/tasks.py", line 389, in task_func alltask.run() File "/root/eyejo/EyeJo/tasks.py", line 371, in run self.run_subdomain_collect() File "/root/eyejo/EyeJo/tasks.py", line 72, in run_subdomain_collect subdomain_collect.main(self.target_dict.get('domain'), self.project_id, self.asset_id, self.task_id, self.yaml_config) File "/root/eyejo/plugin/subdomain_collect.py", line 62, in main TargetHandle.GetIpInfo(schema_target_dict, project_id, asset_id, yaml_config, task_id).main() File "/root/eyejo/projectApp/utils/TargetHandle.py", line 112, in main target_ip_set.update({get_target(self.c_schema_target_dict['ip'].pop(x)).get('new_target') for x in range(len(self.c_schema_target_dict['ip']) - 1, -1, -1) if not check_private_ip(get_target(self.c_schema_target_dict['ip'][x]).get('new_target'))}) KeyError: 'ip'

[kesonn]

一个主域名：站点数量：0

域名数量：7180

IP数量：7172

[ice-doom]

麻烦将日志文件拷贝出来，发送到我邮箱里吧，protp6@protonmail.com

[kesonn]

大佬，我发过去啦，麻烦看看

[ice-doom]

没有收到，垃圾箱也没有

[kesonn]

麻烦再看看？

[ice-doom]

好，已收到

[ice-doom]

重新拉取镜像，运行试试看，以修改这处。

[kesonn]

[2021-05-30 21:24:20,099: WARNING/ForkPoolWorker-2] cookie_value = self.cookie['netcraft_js_verification_challenge'] [2021-05-30 21:24:20,100: WARNING/ForkPoolWorker-2] File "/usr/local/lib/python3.8/dist-packages/requests/cookies.py", line 328, in getitem [2021-05-30 21:24:20,100: WARNING/ForkPoolWorker-2] return self._find_no_duplicates(name) [2021-05-30 21:24:20,100: WARNING/ForkPoolWorker-2] File "/usr/local/lib/python3.8/dist-packages/requests/cookies.py", line 399, in _find_no_duplicates [2021-05-30 21:24:20,100: WARNING/ForkPoolWorker-2] raise KeyError('name=%r, domain=%r, path=%r' % (name, domain, path)) [2021-05-30 21:24:20,100: WARNING/ForkPoolWorker-2] KeyError [2021-05-30 21:24:20,100: WARNING/ForkPoolWorker-2] : [2021-05-30 21:24:20,100: WARNING/ForkPoolWorker-2] "name='netcraft_js_verification_challenge', domain=None, path=None" [2021-05-30 21:36:39,573: ERROR/ForkPoolWorker-2] Task EyeJoTask[8e2156d1-2e19-4d3c-87e8-c564414fb19b] raised unexpected: KeyError('ip') Traceback (most recent call last): File "/usr/local/lib/python3.8/dist-packages/celery/app/trace.py", line 405, in trace_task R = retval = fun(*args, *kwargs) File "/usr/local/lib/python3.8/dist-packages/celery/app/trace.py", line 697, in __protected_call__ return self.run(args, **kwargs) File "/root/eyejo/EyeJo/tasks.py", line 389, in task_func alltask.run() File "/root/eyejo/EyeJo/tasks.py", line 371, in run self.run_subdomain_collect() File "/root/eyejo/EyeJo/tasks.py", line 72, in run_subdomain_collect subdomain_collect.main(self.target_dict.get('domain'), self.project_id, self.asset_id, self.task_id, self.yaml_config) File "/root/eyejo/plugin/subdomain_collect.py", line 62, in main TargetHandle.GetIpInfo(schema_target_dict, project_id, asset_id, yaml_config, task_id).main() File "/root/eyejo/projectApp/utils/TargetHandle.py", line 112, in main target_ip_set.update({get_target(self.c_schema_target_dict['ip'].pop(x)).get('new_target') for x in range(len(self.c_schema_target_dict['ip']) - 1, -1, -1) if not check_private_ip(get_target(self.c_schema_target_dict['ip'][x]).get('new_target'))}) KeyError: 'ip' 一个小时过去了，还是一样报错额，在子域名搜集

[ice-doom]

把目标域名发我测试下，发我邮箱

[ice-doom]

bug已修复，重新拉取镜像即可。

[kesonn]

已解决该问题，感谢