RedSiege / EyeWitness

EyeWitness is designed to take screenshots of websites, provide some server header info, and identify default credentials if possible.
https://www.christophertruncer.com/eyewitness-usage-guide/
GNU General Public License v3.0
5.01k stars 848 forks source link

error in selenium #599

Open ali-0x11 opened 2 years ago

ali-0x11 commented 2 years ago

OS Used - ALL Information (architecture, linux flavor, etc.)

kali linux

Pastebin link to error you are encountering

the tools did not take any screen shoots

Expected behavior (vs. what you encountered)

Trying to make web screenshots using syntax: ./Eyewitness.py -f urllist.txt --web

Any additional information

Process Process-2: Traceback (most recent call last): File "/usr/lib/python3.10/multiprocessing/process.py", line 314, in _bootstrap self.run() File "/usr/lib/python3.10/multiprocessing/process.py", line 108, in run self._target(*self._args, **self._kwargs) File "/home/kali/Desktop/EyeWitness/Python/EyeWitness.py", line 253, in worker_thread driver = create_driver(cli_parsed, user_agent) File "/home/kali/Desktop/EyeWitness/Python/modules/selenium_module.py", line 39, in create_driver profile = webdriver.FirefoxProfile() File "/usr/lib/python3/dist-packages/selenium/webdriver/firefox/firefox_profile.py", line 61, in init with open( FileNotFoundError: [Errno 2] No such file ordirectory:'/usr/lib/python3/distpackages/selenium/webdriver/firefox/webdriver_prefs.json'

catpipeless commented 2 years ago

I'm having this same issue on a new minimal kali installation after running apt install eyewitness. I fixed it by copying an old '/usr/lib/python3/distpackages/selenium/webdriver/firefox/webdriver_prefs.json' to the new device.

digininja commented 2 years ago

Don't use the package manager version, always install from GitHub, it makes debugging stuff a lot easier.

On Fri, 18 Nov 2022, 20:12 catpipeless, @.***> wrote:

I'm having this same issue on a new minimal kali installation after running apt install eyewitness. I fixed it by copying an old '/usr/lib/python3/distpackages/selenium/webdriver/firefox/webdriver_prefs.json' to the new device.

— Reply to this email directly, view it on GitHub https://github.com/FortyNorthSecurity/EyeWitness/issues/599#issuecomment-1320477776, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAA4SWLE3JIMBN2UULBLR7DWI7PLHANCNFSM6AAAAAASEZUZRM . You are receiving this because you are subscribed to this thread.Message ID: @.***>

catpipeless commented 2 years ago

I did try installing it from github, by cloning the project and then running the setup.sh script. This did not resolve the issue.

Relkci commented 2 years ago

This can be merged with #598, still an issue. Might be dependent on specific distro apt repos from setup?

In the mean time, try the fix from #598

ali-0x11 commented 2 years ago

Don't use the package manager version, always install from GitHub, it makes debugging stuff a lot easier. On Fri, 18 Nov 2022, 20:12 catpipeless, @.> wrote: I'm having this same issue on a new minimal kali installation after running apt install eyewitness. I fixed it by copying an old '/usr/lib/python3/distpackages/selenium/webdriver/firefox/webdriver_prefs.json' to the new device. — Reply to this email directly, view it on GitHub <#599 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAA4SWLE3JIMBN2UULBLR7DWI7PLHANCNFSM6AAAAAASEZUZRM . You are receiving this because you are subscribed to this thread.Message ID: @.>

i download it from github but still the same issue

Relkci commented 2 years ago

Try the fix from #598

What distro and version of Linux are you using?

catpipeless commented 2 years ago

I don't see a fix in #598

Relkci commented 2 years ago

I don't see a fix in #598

Oh, right. #587

Find a copy of the missing file and drop it in the expected folder

7h30th3r0n3 commented 1 year ago

I don't think it's related but I'd like it posted here if anyone has the same problem. I got an error message after downgrading urllib3 :

[] Selenium not found. [] Please run the script in the setup directory!

downgrade commands :

pip uninstall urllib3
pip install urllib3==1.22

Once updated everything works again : pip3 install urllib3 --upgrade

:+1:

jeastonIT commented 1 year ago

Same issue...

I tried uninstalling, reinstalling, installing from git only. downgrading. reinstalling selenium.

Nothing works. image

daffi1238 commented 1 year ago

Someone could upload the content of the file '/usr/lib/python3/distpackages/selenium/webdriver/firefox/webdriver_prefs.json'?

I remove all the old versions in my machine.

Thank you guys!

EDIT: I found the proper file!, the content is the next!: { "frozen": { "app.update.auto": false, "app.update.enabled": false, "browser.displayedE10SNotice": 4, "browser.download.manager.showWhenStarting": false, "browser.EULA.override": true, "browser.EULA.3.accepted": true, "browser.link.open_external": 2, "browser.link.open_newwindow": 2, "browser.offline": false, "browser.reader.detectedFirstArticle": true, "browser.safebrowsing.enabled": false, "browser.safebrowsing.malware.enabled": false, "browser.search.update": false, "browser.selfsupport.url" : "", "browser.sessionstore.resume_from_crash": false, "browser.shell.checkDefaultBrowser": false, "browser.tabs.warnOnClose": false, "browser.tabs.warnOnOpen": false, "datareporting.healthreport.service.enabled": false, "datareporting.healthreport.uploadEnabled": false, "datareporting.healthreport.service.firstRun": false, "datareporting.healthreport.logging.consoleEnabled": false, "datareporting.policy.dataSubmissionEnabled": false, "datareporting.policy.dataSubmissionPolicyAccepted": false, "devtools.errorconsole.enabled": true, "dom.disable_open_during_load": false, "extensions.autoDisableScopes": 10, "extensions.blocklist.enabled": false, "extensions.checkCompatibility.nightly": false, "extensions.update.enabled": false, "extensions.update.notifyUser": false, "javascript.enabled": true, "network.manage-offline-status": false, "network.http.phishy-userpass-length": 255, "offline-apps.allow_by_default": true, "prompts.tab_modal.enabled": false, "security.fileuri.origin_policy": 3, "security.fileuri.strict_origin_policy": false, "signon.rememberSignons": false, "toolkit.networkmanager.disable": true, "toolkit.telemetry.prompted": 2, "toolkit.telemetry.enabled": false, "toolkit.telemetry.rejected": true, "xpinstall.signatures.required": false, "xpinstall.whitelist.required": false }, "mutable": { "browser.dom.window.dump.enabled": true, "browser.laterrun.enabled": false, "browser.newtab.url": "about:blank", "browser.newtabpage.enabled": false, "browser.startup.page": 0, "browser.startup.homepage": "about:blank", "browser.startup.homepage_override.mstone": "ignore", "browser.usedOnWindows10.introURL": "about:blank", "dom.max_chrome_script_run_time": 30, "dom.max_script_run_time": 30, "dom.report_all_js_exceptions": true, "javascript.options.showInConsole": true, "network.captive-portal-service.enabled": false, "security.csp.enable": false, "startup.homepage_welcome_url": "about:blank", "startup.homepage_welcome_url.additional": "about:blank", "webdriver_accept_untrusted_certs": true, "webdriver_assume_untrusted_issuer": true } }

Just copy that in /usr/lib/python3/distpackages/selenium/webdriver/firefox/webdriver_prefs.json and it's done!

0x6d6f7468 commented 1 year ago

Heads up to folks hitting this issue: Issue might exist by conflicting selenium versions. Was troubleshooting this with a coworker and the issue existed in /usr/lib/..., but Selenium was found in /usr/local/lib/... and that location contained the webdriver_prefs.json file.

Removing the Selenium module present in /usr/lib/... fixed our issue. Need to research more to see if something else is going on.

cosad3s commented 1 year ago

Maybe, there is another kind of conflict regarding Python3 Selenium because these two folders are quoted:

Maybe distro-dependent I do not know.

Thanks @0x6d6f7468:

$ find /usr/ -name "webdriver_prefs.json"
/usr/local/lib/python2.7/dist-packages/selenium/webdriver/firefox/webdriver_prefs.json
/usr/local/lib/python3.9/dist-packages/selenium/webdriver/firefox/webdriver_prefs.json
/usr/local/lib/python3.7/dist-packages/selenium/webdriver/firefox/webdriver_prefs.json

So I try to copy one of them:

sudo cp /usr/local/lib/python3.9/dist-packages/selenium/webdriver/firefox/webdriver_prefs.json /usr/lib/python3/dist-packages/selenium/webdriver/firefox/webdriver_prefs.json

But, now I have this error:

################################################################################
#                                  EyeWitness                                  #
################################################################################
#           FortyNorth Security - https://www.fortynorthsecurity.com           #
################################################################################

Starting Web Requests (41 Hosts)
Message: Service geckodriver unexpectedly exited. Status code was: 64

Edit: Ok fine, I just ran the setup.sh, and https://github.com/mozilla/geckodriver/releases/download/v0.32.0/geckodriver-v0.32.0-linux64.tar.gz was missing on my system. Works now :)

0x6d6f7468 commented 1 year ago

Glad you got it working. Thinking maybe we should add a check in the setup script that either removes existing versions of Selenium, or copies the downloaded webdriver_prefs.json to the /usr/lib directory. Will investigate when I have a moment.

ChrisTruncer commented 1 year ago

that is a good idea, and likely should get added in

0x6d6f7468 commented 1 year ago

I can sketch something up quick if you like. Do you have a preference between deleting existing selenium or copying webdriver_prefs.json all over the place? Or should the user get a prompted choice?

digininja commented 1 year ago

My instant reaction to this is don't delete anything already on the system without full confirmation. I'd be very annoyed if my already configured and working stuff stopped working due to installing a new tool.

On Sun, 8 Jan 2023, 19:44 moth, @.***> wrote:

I can sketch something up quick if you like. Do you have a preference between deleting existing selenium or copying webdriver_prefs.json all over the place? Or should the user get a prompted choice?

— Reply to this email directly, view it on GitHub https://github.com/FortyNorthSecurity/EyeWitness/issues/599#issuecomment-1374912267, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAA4SWKZAPIUSHAOWDRWH3LWRMKKTANCNFSM6AAAAAASEZUZRM . You are receiving this because you commented.Message ID: @.***>

0x6d6f7468 commented 1 year ago

Yeah that's fair, digi. The solution seemed like a bit of a kludge in the moment, but was mostly to get another tester running. I'm not aware of an issue with deleting the /usr/lib location but perhaps even just symlinking the webdriver_prefs file would be good enough?

digininja commented 1 year ago

I don't know enough about how it works to comment on putting a symlink in.

On Sun, 8 Jan 2023, 19:48 moth, @.***> wrote:

Yeah that's fair, digi. The solution seemed like a bit of a kludge in the moment, but was mostly to get another tester running. I'm not aware of an issue with deleting the /usr/lib location but perhaps even just symlinking the webdriver_prefs file would be good enough?

— Reply to this email directly, view it on GitHub https://github.com/FortyNorthSecurity/EyeWitness/issues/599#issuecomment-1374912947, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAA4SWPAP5KQKAB37RBSRTDWRMKZZANCNFSM6AAAAAASEZUZRM . You are receiving this because you commented.Message ID: @.***>

0x6d6f7468 commented 1 year ago

Ok. I can look at a few options for setup script changes and report back tomorrow with what seems to be the best solution.

digininja commented 10 months ago

I've just had a look at the closed tickets and I think I must have sorted it directly with Chris.

The problem was Kali wasn't working correctly with the pip installed packages but worked fine with those installed from apt so we changed the installer to use those.

If you build it to use venv, make sure you test a completely fresh Kali install so there isn't any residue from an only apt instant lying around to confuse things.

On Sun, 8 Jan 2023, 19:58 moth, @.***> wrote:

Ok. I can look at a few options for setup script changes and report back tomorrow with what seems to be the best solution.

— Reply to this email directly, view it on GitHub https://github.com/FortyNorthSecurity/EyeWitness/issues/599#issuecomment-1374914576, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAA4SWOLQBSN4GEXYBIRU2TWRML4XANCNFSM6AAAAAASEZUZRM . You are receiving this because you commented.Message ID: @.***>

Relkci commented 6 months ago

@digininja This can be closed at this point? between Chris' work and the new setup script, i think this might be resolved.

digininja commented 6 months ago

Yes, I think it is sorted out now.

On Mon, 20 May 2024, 20:41 Kent Ickler, @.***> wrote:

@digininja https://github.com/digininja This can be closed at this point? between Chris' work and the new setup script, i think this might be resolved.

— Reply to this email directly, view it on GitHub https://github.com/RedSiege/EyeWitness/issues/599#issuecomment-2121084332, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAA4SWIXDZ5HG3NTSAWZVLTZDJGWLAVCNFSM6AAAAAASEZUZROVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMRRGA4DIMZTGI . You are receiving this because you were mentioned.Message ID: @.***>