smicallef / spiderfoot

SpiderFoot automates OSINT for threat intelligence and mapping your attack surface.
http://www.spiderfoot.net
MIT License
12.76k stars 2.23k forks source link

Getting errors #1869

Open demdbeef opened 3 months ago

demdbeef commented 3 months ago

Screenshot_2024-06-17_16_00_05 Getting this error on the latest stable verison

toro- commented 2 months ago

I am getting this issue with v4.0.tar.gz

Steps I have taken:

  1. ensure up to date (using Debian on WSL2)
  2. updated pip
  3. cleared pip cache
  4. repeated the steps in venv

Each time, getting the following output:

pip install -r requirements.txt
Collecting adblockparser<1,>=0.7
  Using cached adblockparser-0.7-py2.py3-none-any.whl (13 kB)
Collecting dnspython<3,>=2.1.0
  Using cached dnspython-2.6.1-py3-none-any.whl (307 kB)
Collecting ExifRead<3,>=2.3.2
  Using cached ExifRead-2.3.2-py3-none-any.whl (38 kB)
Collecting CherryPy<19,>=18.6.1
  Using cached CherryPy-18.10.0-py3-none-any.whl (349 kB)
Collecting cherrypy-cors<2,>=1.6
  Using cached cherrypy_cors-1.7.0-py3-none-any.whl (5.2 kB)
Collecting Mako<2,>=1.1.5
  Using cached Mako-1.3.5-py3-none-any.whl (78 kB)
Collecting beautifulsoup4<5,>=4.10.0
  Using cached beautifulsoup4-4.12.3-py3-none-any.whl (147 kB)
Collecting lxml<5,>=4.6.3
  Using cached lxml-4.9.4-cp311-cp311-manylinux_2_28_x86_64.whl (7.9 MB)
Collecting netaddr<1,>=0.8.0
  Using cached netaddr-0.10.1-py2.py3-none-any.whl (2.2 MB)
Collecting pysocks<2,>=1.7.1
  Using cached PySocks-1.7.1-py3-none-any.whl (16 kB)
Collecting requests<3,>=2.26.0
  Using cached requests-2.32.3-py3-none-any.whl (64 kB)
Collecting ipwhois<1.2.0,>=1.1.0
  Using cached ipwhois-1.1.0-py2.py3-none-any.whl (74 kB)
Collecting ipaddr<3,>=2.2.0
  Using cached ipaddr-2.2.0.tar.gz (26 kB)
  Preparing metadata (setup.py) ... done
Collecting phonenumbers<9,>=8.12.34
  Using cached phonenumbers-8.13.40-py2.py3-none-any.whl (2.6 MB)
Collecting pygexf<0.3,>=0.2.2
  Using cached pygexf-0.2.2.tar.gz (5.1 kB)
  Preparing metadata (setup.py) ... done
Collecting PyPDF2<2,>=1.26.0
  Using cached PyPDF2-1.28.6-py3-none-any.whl (87 kB)
Collecting python-whois<0.8,>=0.7.3
  Using cached python-whois-0.7.3.tar.gz (91 kB)
  Preparing metadata (setup.py) ... done
Collecting secure<0.4.0,>=0.3.0
  Using cached secure-0.3.0-py3-none-any.whl (9.6 kB)
Collecting pyOpenSSL<22,>=21.0.0
  Using cached pyOpenSSL-21.0.0-py2.py3-none-any.whl (55 kB)
Collecting python-docx<0.9,>=0.8.11
  Using cached python-docx-0.8.11.tar.gz (5.6 MB)
  Preparing metadata (setup.py) ... done
Collecting python-pptx<0.7,>=0.6.21
  Using cached python_pptx-0.6.23-py3-none-any.whl (471 kB)
Collecting networkx<2.7,>=2.6.3
  Using cached networkx-2.6.3-py3-none-any.whl (1.9 MB)
Collecting cryptography<4,>=3.4.8
  Using cached cryptography-3.4.8-cp36-abi3-manylinux_2_24_x86_64.whl (3.0 MB)
Collecting publicsuffixlist<0.8,>=0.7.9
  Using cached publicsuffixlist-0.7.14-py2.py3-none-any.whl (95 kB)
Collecting openpyxl<4,>=3.0.9
  Using cached openpyxl-3.1.5-py2.py3-none-any.whl (250 kB)
Collecting pyyaml<6,>=5.4.1
  Using cached PyYAML-5.4.1.tar.gz (175 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... error
  error: subprocess-exited-with-error

  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [54 lines of output]
      running egg_info
      writing lib3/PyYAML.egg-info/PKG-INFO
      writing dependency_links to lib3/PyYAML.egg-info/dependency_links.txt
      writing top-level names to lib3/PyYAML.egg-info/top_level.txt
      Traceback (most recent call last):
        File "/home/alasdair/spiderfoot/spiderfoot-4.0/spider/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in <module>
          main()
        File "/home/alasdair/spiderfoot/spiderfoot-4.0/spider/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
          json_out['return_val'] = hook(**hook_input['kwargs'])
                                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/home/alasdair/spiderfoot/spiderfoot-4.0/spider/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 118, in get_requires_for_build_wheel
          return hook(config_settings)
                 ^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-rbfxdewc/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 327, in get_requires_for_build_wheel
          return self._get_build_requires(config_settings, requirements=[])
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-rbfxdewc/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 297, in _get_build_requires
          self.run_setup()
        File "/tmp/pip-build-env-rbfxdewc/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 313, in run_setup
          exec(code, locals())
        File "<string>", line 271, in <module>
        File "/tmp/pip-build-env-rbfxdewc/overlay/lib/python3.11/site-packages/setuptools/__init__.py", line 103, in setup
          return distutils.core.setup(**attrs)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-rbfxdewc/overlay/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 184, in setup
          return run_commands(dist)
                 ^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-rbfxdewc/overlay/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 200, in run_commands
          dist.run_commands()
        File "/tmp/pip-build-env-rbfxdewc/overlay/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 970, in run_commands
          self.run_command(cmd)
        File "/tmp/pip-build-env-rbfxdewc/overlay/lib/python3.11/site-packages/setuptools/dist.py", line 974, in run_command
          super().run_command(command)
        File "/tmp/pip-build-env-rbfxdewc/overlay/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 989, in run_command
          cmd_obj.run()
        File "/tmp/pip-build-env-rbfxdewc/overlay/lib/python3.11/site-packages/setuptools/command/egg_info.py", line 321, in run
          self.find_sources()
        File "/tmp/pip-build-env-rbfxdewc/overlay/lib/python3.11/site-packages/setuptools/command/egg_info.py", line 329, in find_sources
          mm.run()
        File "/tmp/pip-build-env-rbfxdewc/overlay/lib/python3.11/site-packages/setuptools/command/egg_info.py", line 550, in run
          self.add_defaults()
        File "/tmp/pip-build-env-rbfxdewc/overlay/lib/python3.11/site-packages/setuptools/command/egg_info.py", line 588, in add_defaults
          sdist.add_defaults(self)
        File "/tmp/pip-build-env-rbfxdewc/overlay/lib/python3.11/site-packages/setuptools/command/sdist.py", line 102, in add_defaults
          super().add_defaults()
        File "/tmp/pip-build-env-rbfxdewc/overlay/lib/python3.11/site-packages/setuptools/_distutils/command/sdist.py", line 250, in add_defaults
          self._add_defaults_ext()
        File "/tmp/pip-build-env-rbfxdewc/overlay/lib/python3.11/site-packages/setuptools/_distutils/command/sdist.py", line 335, in _add_defaults_ext
          self.filelist.extend(build_ext.get_source_files())
                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "<string>", line 201, in get_source_files
        File "/tmp/pip-build-env-rbfxdewc/overlay/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 107, in __getattr__
          raise AttributeError(attr)
      AttributeError: cython_sources
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.
toro- commented 2 months ago

I installed without issue on Rocky Linux 9.4. Perhaps an issue relating to deb packaging ?

su-anonymous commented 2 months ago

I had the same issue installing it on Ubuntu 24.04 LTS. Followed the first workaround in this stack overflow thread which resolved it for me: https://stackoverflow.com/questions/77490435/attributeerror-cython-sources

Sounds like its an issue with PyYAML and Cython.

Technet8394 commented 1 month ago

I manged to fix my issue with the second work around in the thread, using debian on a server btw