lanmaster53 / recon-ng

Open Source Intelligence gathering tool aimed at reducing the time spent harvesting information from open sources.
GNU General Public License v3.0
4.1k stars 646 forks source link

Profiller issue. #177

Closed michaelpotter16 closed 6 months ago

michaelpotter16 commented 1 year ago

After running profiler:

Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/requests/models.py", line 910, in json
return complexjson.loads(self.text, **kwargs)
File "/usr/lib/python3/dist-packages/simplejson/init.py", line 525, in loads
return _default_decoder.decode(s)
File "/usr/lib/python3/dist-packages/simplejson/decoder.py", line 373, in decode
raise JSONDecodeError("Extra data", s, end, len(s))
simplejson.errors.JSONDecodeError: Extra data: line 1 column 4 - line 1 column 15 (char 3 - 14)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/usr/share/recon-ng/recon/core/module.py", line 342, in do_run
self.run()
File "/usr/share/recon-ng/recon/core/module.py", line 336, in run
self.module_run(*params)
File "/home/kali/.recon-ng/modules/recon/profiles-profiles/profiler.py", line 26, in module_run
self.thread(resp.json()['sites'], user)
File "/usr/lib/python3/dist-packages/requests/models.py", line 917, in json
raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
requests.exceptions.JSONDecodeError: [Errno Extra data] 404: Not Found: 3


[!] Something broken? See https://github.com/lanmaster53/recon-ng/wiki/Troubleshooting#issue-reporting.

RileighBurgin commented 1 year ago

I am getting the exact same error using my Kali Linux VM on Oracle VirtualBox running within my Ubuntu 22.04.1 host OS. My Kali Linux VM has two adapters setup, one for my home internet and one for host-only connectivity to other virtual machines I'm using for learning and practice.

samari-k commented 1 year ago

It seems like the profiler module is based on an older version of WhatsMyName. It tries to fetch the file https://raw.githubusercontent.com/WebBreacher/WhatsMyName/master/web_accounts_list.json that doesn't exist (anymore).

I used this workaround to get it running:

This would also fix the Issues #174 and #172 (which are the same like this one)

(edit: there seems already to be a pull request fixing the issue: https://github.com/lanmaster53/recon-ng-marketplace/pull/230)

anjannair commented 1 year ago

It seems like the profiler module is based on an older version of WhatsMyName. It tries to fetch the file https://raw.githubusercontent.com/WebBreacher/WhatsMyName/master/web_accounts_list.json that doesn't exist (anymore).

I used this workaround to get it running:

* edit the file  `~/.recon-ng/modules/recon/profiles-profiles/profiler.py` as follows:

  * change url in line 21 to `https://raw.githubusercontent.com/WebBreacher/WhatsMyName/main/wmn-data.json`
  * edit dictionary keys in the function `module_thread` (line 28 to 38)

    * `check_uri` becomes `uri_check`
    * `account_existence_code` becomes `e_code`
    * `account_existence_string` becomes `e_string`
    * `category` becomes `cat`

This would also fix the Issues #174 and #172 (which are the same like this one)

(edit: there seems already to be a pull request fixing the issue: lanmaster53/recon-ng-marketplace#230)

Yup this is the working fix for now!

lanmaster53 commented 6 months ago

All module related issues, including dependencies, should be raised in the module repository.

A fix was merged to address this issue.