smicallef / spiderfoot

SpiderFoot automates OSINT for threat intelligence and mapping your attack surface.
http://www.spiderfoot.net
MIT License
13.11k stars 2.27k forks source link

Fresh installation causes LXML wheel build error #1896

Open Schellcunn opened 2 weeks ago

Schellcunn commented 2 weeks ago

on fresh computer windows 11, after insalling python and git. running "pip install -r requirements.txt" causes the installation of dependencies to crash image

Workaround seems to be to remove line 8 on requirements.txt and running "pip install lxml" before running "pip install -r requirements.txt" when doing this the dependencies install correctly and lxml works

l0n3m4n commented 1 week ago

not a developer to this tool, but i created a bash script from scratch to solve this issue. i also updated some packages to newer versions, which caused errors during installation.

#!/bin/bash
if ! command -v pip &> /dev/null
then
    echo "pip not found, installing pip..."
    if command -v apt &> /dev/null; then
        sudo apt update && sudo apt install -y python3-pip
    elif command -v yum &> /dev/null; then
        sudo yum install -y python3-pip
    else
        echo "Please install pip manually."
        exit 1
    fi
fi

echo "pip is installed."
cat <<EOL > requirements.txt
adblockparser==0.7
dnspython==2.1.0
ExifRead==2.3.2
CherryPy==18.6.1
cherrypy-cors==1.6
Mako==1.1.5
beautifulsoup4==4.10.0
lxml==4.6.3
netaddr==0.8.0
pysocks==1.7.1
requests==2.26.0
ipwhois==1.1.0
ipaddr==2.2.0
phonenumbers==8.12.34
pygexf==0.2.2
PyPDF2==1.26.0
python-whois==0.7.3
secure==0.3.0
pyOpenSSL==21.0.0
python-docx==0.8.11
python-pptx==0.6.21
networkx==2.6.3
cryptography==3.4.8
publicsuffixlist==0.7.9
openpyxl==3.0.9
pyyaml==5.4.1
EOL

echo "requirements.txt file created."
echo "Installing packages..."
pip install -r requirements.txt 
if [ $? -eq 0 ]; then
    echo "All packages installed successfully."
else
    echo "Some packages failed to install. Please check the output for errors."
fi