Lookyloo / lookyloo

Lookyloo is a web interface that allows users to capture a website page and then display a tree of domains that call each other.
https://www.lookyloo.eu
Other
663 stars 83 forks source link

[Bug]: Capture Tree doesn't show #572

Closed jeroengui closed 1 year ago

jeroengui commented 1 year ago

What happened?

After finishing the install almost everything seems to work fine, but the tree won't load in any browser. Not before or afte renabling the reverse proxy. It did not yet enable the modules, but am not planning on using them. Could it be something to do with the ffmpeg or avconv error messages?

Screenshot 2023-01-16 141955

If the issue is related to the web interface, what browsers are you seeing the problem on?

Firefox

Relevant log output

[2023-01-16 14:02:43 +0100] [178771] [INFO] Starting gunicorn 20.1.0
[2023-01-16 14:02:43 +0100] [178771] [INFO] Listening at: http://0.0.0.0:5100 (178771)
[2023-01-16 14:02:43 +0100] [178771] [INFO] Using worker: sync
[2023-01-16 14:02:43 +0100] [178781] [INFO] Booting worker with pid: 178781
[2023-01-16 14:02:43 +0100] [178782] [INFO] Booting worker with pid: 178782
[2023-01-16 14:02:43 +0100] [178783] [INFO] Booting worker with pid: 178783
[2023-01-16 14:02:43 +0100] [178784] [INFO] Booting worker with pid: 178784
[2023-01-16 14:02:43 +0100] [178785] [INFO] Booting worker with pid: 178785
[2023-01-16 14:02:43 +0100] [178786] [INFO] Booting worker with pid: 178786
[2023-01-16 14:02:43 +0100] [178787] [INFO] Booting worker with pid: 178787
[2023-01-16 14:02:44 +0100] [178788] [INFO] Booting worker with pid: 178788
[2023-01-16 14:02:44 +0100] [178790] [INFO] Booting worker with pid: 178790
[2023-01-16 14:02:44 +0100] [178791] [INFO] Booting worker with pid: 178791
/home/jeroen/.cache/pypoetry/virtualenvs/lookyloo-ANuzfK_p-py3.10/lib/python3.10/site-packages/pydub/utils.py:170: RuntimeWarning: Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work
  warn("Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work", RuntimeWarning)
/home/jeroen/.cache/pypoetry/virtualenvs/lookyloo-ANuzfK_p-py3.10/lib/python3.10/site-packages/pydub/utils.py:170: RuntimeWarning: Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work
  warn("Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work", RuntimeWarning)
/home/jeroen/.cache/pypoetry/virtualenvs/lookyloo-ANuzfK_p-py3.10/lib/python3.10/site-packages/pydub/utils.py:170: RuntimeWarning: Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work
  warn("Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work", RuntimeWarning)
/home/jeroen/.cache/pypoetry/virtualenvs/lookyloo-ANuzfK_p-py3.10/lib/python3.10/site-packages/pydub/utils.py:170: RuntimeWarning: Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work
  warn("Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work", RuntimeWarning)
/home/jeroen/.cache/pypoetry/virtualenvs/lookyloo-ANuzfK_p-py3.10/lib/python3.10/site-packages/pydub/utils.py:170: RuntimeWarning: Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work
  warn("Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work", RuntimeWarning)
/home/jeroen/.cache/pypoetry/virtualenvs/lookyloo-ANuzfK_p-py3.10/lib/python3.10/site-packages/pydub/utils.py:170: RuntimeWarning: Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work
  warn("Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work", RuntimeWarning)
/home/jeroen/.cache/pypoetry/virtualenvs/lookyloo-ANuzfK_p-py3.10/lib/python3.10/site-packages/pydub/utils.py:170: RuntimeWarning: Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work
  warn("Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work", RuntimeWarning)
/home/jeroen/.cache/pypoetry/virtualenvs/lookyloo-ANuzfK_p-py3.10/lib/python3.10/site-packages/pydub/utils.py:170: RuntimeWarning: Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work
  warn("Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work", RuntimeWarning)
/home/jeroen/.cache/pypoetry/virtualenvs/lookyloo-ANuzfK_p-py3.10/lib/python3.10/site-packages/pydub/utils.py:170: RuntimeWarning: Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work
  warn("Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work", RuntimeWarning)
/home/jeroen/.cache/pypoetry/virtualenvs/lookyloo-ANuzfK_p-py3.10/lib/python3.10/site-packages/pydub/utils.py:170: RuntimeWarning: Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work
  warn("Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work", RuntimeWarning)
/home/jeroen/.cache/pypoetry/virtualenvs/lookyloo-ANuzfK_p-py3.10/lib/python3.10/site-packages/pydub/utils.py:170: RuntimeWarning: Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work
  warn("Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work", RuntimeWarning)
/home/jeroen/.cache/pypoetry/virtualenvs/lookyloo-ANuzfK_p-py3.10/lib/python3.10/site-packages/pydub/utils.py:170: RuntimeWarning: Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work
  warn("Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work", RuntimeWarning)
/home/jeroen/.cache/pypoetry/virtualenvs/lookyloo-ANuzfK_p-py3.10/lib/python3.10/site-packages/pydub/utils.py:170: RuntimeWarning: Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work
  warn("Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work", RuntimeWarning)
/home/jeroen/.cache/pypoetry/virtualenvs/lookyloo-ANuzfK_p-py3.10/lib/python3.10/site-packages/pydub/utils.py:170: RuntimeWarning: Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work
  warn("Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work", RuntimeWarning)
Unable to find PhishingInitiative in config file.
Falling back on sample config, please initialize the modules config file.
Unable to find PhishingInitiative in config file.
Falling back on sample config, please initialize the modules config file.
Unable to find PhishingInitiative in config file.
Falling back on sample config, please initialize the modules config file.
Unable to setup the PhishingInitiative module
Unable to find VirusTotal in config file.
Falling back on sample config, please initialize the modules config file.
Unable to setup the PhishingInitiative module
Unable to find VirusTotal in config file.
Falling back on sample config, please initialize the modules config file.
Unable to setup the VirusTotal module
Unable to find MISP in config file.
Falling back on sample config, please initialize the modules config file.
Unable to setup the MISP module
Unable to find UniversalWhois in config file.
Falling back on sample config, please initialize the modules config file.
Rafiot commented 1 year ago

Yep, sorry for that, I needed to update the d3js SRI record.

Just in case it happens again (I need to make it better, it is sub obtimal right now), you can run the following:

./tools/3rdparty.py
./tools/generate_sri.py

And restart the website.