PaloAltoNetworks / minemeld-core

Engine of MineMeld
Apache License 2.0
141 stars 96 forks source link

Failure to install minemeld-core as python module #255

Open kidmose opened 6 years ago

kidmose commented 6 years ago

I'm developing an extension for minemeld, subclassing various classes in ft.minemeld, hence I'm importing minemeld in the python code for my nodes. The extension works fine, when added to a running minemeld instances, but I'd like to run local tests (e.g. nosetest).

I've tried installing the requirement for minemeld-core and then installing it into my virtual env.

First, depencies:

pip install -r ../../git-reps/minemeld-core/requirements.txt
pip install -r ../../git-reps/minemeld-core/requirements-dev.txt

No error thus far. Then I try to install minemeld core:

pip install -e ../../git-reps/minemeld-core/

This fails (Snippet):

Installing collected packages: minemeld-core
  Running setup.py develop for minemeld-core
    Complete output from command /home/egk/git-reps/domainlists/venv/bin/python2 -c "import setuptools, tokenize;__file__='/home/egk/git-reps/minemeld-core/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" develop --no-deps:
    running develop
    running egg_info
    writing requirements to minemeld_core.egg-info/requires.txt
    writing minemeld_core.egg-info/PKG-INFO
    writing top-level names to minemeld_core.egg-info/top_level.txt
    writing dependency_links to minemeld_core.egg-info/dependency_links.txt
    writing entry points to minemeld_core.egg-info/entry_points.txt
    reading manifest file 'minemeld_core.egg-info/SOURCES.txt'
    writing manifest file 'minemeld_core.egg-info/SOURCES.txt'
    running build_ext
    building 'minemeld.packages.gdns._ares' extension
    x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fno-strict-aliasing -Wdate-time -D_FORTIFY_SOURCE=2 -g -fstack-protector-strong -Wformat -Werror=format-security -fPIC -DHAVE_NETDB_H= -I/usr/include/python2.7 -c minemeld/packages/gdns/_ares.c -o build/temp.linux-x86_64-2.7/minemeld/packages/gdns/_ares.o
    minemeld/packages/gdns/_ares.c:283:18: fatal error: ares.h: No such file or directory
    compilation terminated.
    error: command 'x86_64-linux-gnu-gcc' failed with exit status 1

    ----------------------------------------
Command "/home/egk/git-reps/domainlists/venv/bin/python2 -c "import setuptools, tokenize;__file__='/home/egk/git-reps/minemeld-core/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" develop --no-deps" failed with error code 1 in /home/egk/git-reps/minemeld-core/

Any idea as to why and how to fix/overcome? Thanks!

kidmose commented 6 years ago

And the full output of the above:

 $ pip install -r ../../minemeld-core/requirements.txt 
Requirement already satisfied: pip>=9.0.1 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from -r ../../minemeld-core/requirements.txt (line 1))
Requirement already satisfied: amqp==1.4.6 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from -r ../../minemeld-core/requirements.txt (line 2))
Requirement already satisfied: gevent==1.0.2 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from -r ../../minemeld-core/requirements.txt (line 3))
Requirement already satisfied: greenlet==0.4.7 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from -r ../../minemeld-core/requirements.txt (line 4))
Requirement already satisfied: hiredis==0.2.0 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from -r ../../minemeld-core/requirements.txt (line 5))
Requirement already satisfied: PyYAML==3.11 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from -r ../../minemeld-core/requirements.txt (line 6))
Requirement already satisfied: redis==2.10.5 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from -r ../../minemeld-core/requirements.txt (line 7))
Requirement already satisfied: requests[security]==2.7.0 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from -r ../../minemeld-core/requirements.txt (line 8))
Requirement already satisfied: plyvel==0.9 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from -r ../../minemeld-core/requirements.txt (line 9))
Requirement already satisfied: netaddr==0.7.18 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from -r ../../minemeld-core/requirements.txt (line 10))
Requirement already satisfied: antlr4-python2-runtime==4.5.2 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from -r ../../minemeld-core/requirements.txt (line 11))
Requirement already satisfied: jmespath==0.7.1 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from -r ../../minemeld-core/requirements.txt (line 12))
Requirement already satisfied: click==4.1 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from -r ../../minemeld-core/requirements.txt (line 13))
Requirement already satisfied: pan-python==0.10.0 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from -r ../../minemeld-core/requirements.txt (line 14))
Requirement already satisfied: stix==1.1.1.6 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from -r ../../minemeld-core/requirements.txt (line 15))
Requirement already satisfied: cybox==2.1.0.12 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from -r ../../minemeld-core/requirements.txt (line 16))
Requirement already satisfied: libtaxii==1.1.107 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from -r ../../minemeld-core/requirements.txt (line 17))
Requirement already satisfied: pytz==2015.4 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from -r ../../minemeld-core/requirements.txt (line 18))
Requirement already satisfied: certifi in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from -r ../../minemeld-core/requirements.txt (line 19))
Requirement already satisfied: ujson==1.34 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from -r ../../minemeld-core/requirements.txt (line 20))
Requirement already satisfied: filelock==2.0.4 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from -r ../../minemeld-core/requirements.txt (line 21))
Requirement already satisfied: sleekxmpp==1.3.1 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from -r ../../minemeld-core/requirements.txt (line 22))
Requirement already satisfied: beautifulsoup4==4.4.1 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from -r ../../minemeld-core/requirements.txt (line 23))
Requirement already satisfied: cifsdk==2.0.0b7 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from -r ../../minemeld-core/requirements.txt (line 24))
Requirement already satisfied: lz4==0.8.2 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from -r ../../minemeld-core/requirements.txt (line 25))
Requirement already satisfied: networkx==1.11 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from -r ../../minemeld-core/requirements.txt (line 26))
Requirement already satisfied: unicodecsv==0.14.1 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from -r ../../minemeld-core/requirements.txt (line 27))
Requirement already satisfied: pyOpenSSL; extra == "security" in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from requests[security]==2.7.0->-r ../../minemeld-core/requirements.txt (line 8))
Requirement already satisfied: ndg-httpsclient; extra == "security" in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from requests[security]==2.7.0->-r ../../minemeld-core/requirements.txt (line 8))
Requirement already satisfied: pyasn1; extra == "security" in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from requests[security]==2.7.0->-r ../../minemeld-core/requirements.txt (line 8))
Requirement already satisfied: python-dateutil in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from stix==1.1.1.6->-r ../../minemeld-core/requirements.txt (line 15))
Requirement already satisfied: lxml>=2.3 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from stix==1.1.1.6->-r ../../minemeld-core/requirements.txt (line 15))
Requirement already satisfied: six>=1.9.0 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from libtaxii==1.1.107->-r ../../minemeld-core/requirements.txt (line 17))
Requirement already satisfied: pytricia>=0.9.0 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from cifsdk==2.0.0b7->-r ../../minemeld-core/requirements.txt (line 24))
Requirement already satisfied: arrow>=0.6.0 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from cifsdk==2.0.0b7->-r ../../minemeld-core/requirements.txt (line 24))
Requirement already satisfied: ipaddress>=1.0.16 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from cifsdk==2.0.0b7->-r ../../minemeld-core/requirements.txt (line 24))
Requirement already satisfied: prettytable>=0.7.2 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from cifsdk==2.0.0b7->-r ../../minemeld-core/requirements.txt (line 24))
Requirement already satisfied: pytest>=2.7.0 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from cifsdk==2.0.0b7->-r ../../minemeld-core/requirements.txt (line 24))
Requirement already satisfied: decorator>=3.4.0 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from networkx==1.11->-r ../../minemeld-core/requirements.txt (line 26))
Requirement already satisfied: cryptography>=2.1.4 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from pyOpenSSL; extra == "security"->requests[security]==2.7.0->-r ../../minemeld-core/requirements.txt (line 8))
Requirement already satisfied: backports.functools-lru-cache==1.2.1 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from arrow>=0.6.0->cifsdk==2.0.0b7->-r ../../minemeld-core/requirements.txt (line 24))
Requirement already satisfied: attrs>=17.2.0 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from pytest>=2.7.0->cifsdk==2.0.0b7->-r ../../minemeld-core/requirements.txt (line 24))
Requirement already satisfied: pluggy<0.7,>=0.5 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from pytest>=2.7.0->cifsdk==2.0.0b7->-r ../../minemeld-core/requirements.txt (line 24))
Requirement already satisfied: funcsigs; python_version < "3.0" in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from pytest>=2.7.0->cifsdk==2.0.0b7->-r ../../minemeld-core/requirements.txt (line 24))
Requirement already satisfied: setuptools in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from pytest>=2.7.0->cifsdk==2.0.0b7->-r ../../minemeld-core/requirements.txt (line 24))
Requirement already satisfied: py>=1.5.0 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from pytest>=2.7.0->cifsdk==2.0.0b7->-r ../../minemeld-core/requirements.txt (line 24))
Requirement already satisfied: cffi>=1.7; platform_python_implementation != "PyPy" in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from cryptography>=2.1.4->pyOpenSSL; extra == "security"->requests[security]==2.7.0->-r ../../minemeld-core/requirements.txt (line 8))
Requirement already satisfied: enum34; python_version < "3" in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from cryptography>=2.1.4->pyOpenSSL; extra == "security"->requests[security]==2.7.0->-r ../../minemeld-core/requirements.txt (line 8))
Requirement already satisfied: idna>=2.1 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from cryptography>=2.1.4->pyOpenSSL; extra == "security"->requests[security]==2.7.0->-r ../../minemeld-core/requirements.txt (line 8))
Requirement already satisfied: asn1crypto>=0.21.0 in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from cryptography>=2.1.4->pyOpenSSL; extra == "security"->requests[security]==2.7.0->-r ../../minemeld-core/requirements.txt (line 8))
Requirement already satisfied: pycparser in /home/egk/git-reps/domainlists/venv/lib/python2.7/site-packages (from cffi>=1.7; platform_python_implementation != "PyPy"->cryptography>=2.1.4->pyOpenSSL; extra == "security"->requests[security]==2.7.0->-r ../../minemeld-core/requirements.txt (line 8))
(venv) egk@egk-aaubox ~/git-reps/domainlists/domainlists $ 
(venv) egk@egk-aaubox ~/git-reps/domainlists/domainlists $ 
(venv) egk@egk-aaubox ~/git-reps/domainlists/domainlists $ 
(venv) egk@egk-aaubox ~/git-reps/domainlists/domainlists $ cd ../../
(venv) egk@egk-aaubox ~/git-reps $ cd domainlists/
(venv) egk@egk-aaubox ~/git-reps/domainlists $ pip install -e ../../git-reps/minemeld-
minemeld-core/            minemeld-node-prototypes/ 
(venv) egk@egk-aaubox ~/git-reps/domainlists $ pip install -e ../../git-reps/minemeld-core/
Obtaining file:///home/egk/git-reps/minemeld-core
Requirement already satisfied: pip>=9.0.1 in ./venv/lib/python2.7/site-packages (from minemeld-core==0.9.44)
Requirement already satisfied: amqp==1.4.6 in ./venv/lib/python2.7/site-packages (from minemeld-core==0.9.44)
Requirement already satisfied: gevent==1.0.2 in ./venv/lib/python2.7/site-packages (from minemeld-core==0.9.44)
Requirement already satisfied: greenlet==0.4.7 in ./venv/lib/python2.7/site-packages (from minemeld-core==0.9.44)
Requirement already satisfied: hiredis==0.2.0 in ./venv/lib/python2.7/site-packages (from minemeld-core==0.9.44)
Requirement already satisfied: PyYAML==3.11 in ./venv/lib/python2.7/site-packages (from minemeld-core==0.9.44)
Requirement already satisfied: redis==2.10.5 in ./venv/lib/python2.7/site-packages (from minemeld-core==0.9.44)
Requirement already satisfied: requests[security]==2.7.0 in ./venv/lib/python2.7/site-packages (from minemeld-core==0.9.44)
Requirement already satisfied: plyvel==0.9 in ./venv/lib/python2.7/site-packages (from minemeld-core==0.9.44)
Requirement already satisfied: netaddr==0.7.18 in ./venv/lib/python2.7/site-packages (from minemeld-core==0.9.44)
Requirement already satisfied: antlr4-python2-runtime==4.5.2 in ./venv/lib/python2.7/site-packages (from minemeld-core==0.9.44)
Requirement already satisfied: jmespath==0.7.1 in ./venv/lib/python2.7/site-packages (from minemeld-core==0.9.44)
Requirement already satisfied: click==4.1 in ./venv/lib/python2.7/site-packages (from minemeld-core==0.9.44)
Requirement already satisfied: pan-python==0.10.0 in ./venv/lib/python2.7/site-packages (from minemeld-core==0.9.44)
Requirement already satisfied: stix==1.1.1.6 in ./venv/lib/python2.7/site-packages (from minemeld-core==0.9.44)
Requirement already satisfied: cybox==2.1.0.12 in ./venv/lib/python2.7/site-packages (from minemeld-core==0.9.44)
Requirement already satisfied: libtaxii==1.1.107 in ./venv/lib/python2.7/site-packages (from minemeld-core==0.9.44)
Requirement already satisfied: pytz==2015.4 in ./venv/lib/python2.7/site-packages (from minemeld-core==0.9.44)
Requirement already satisfied: certifi in ./venv/lib/python2.7/site-packages (from minemeld-core==0.9.44)
Requirement already satisfied: ujson==1.34 in ./venv/lib/python2.7/site-packages (from minemeld-core==0.9.44)
Requirement already satisfied: filelock==2.0.4 in ./venv/lib/python2.7/site-packages (from minemeld-core==0.9.44)
Requirement already satisfied: sleekxmpp==1.3.1 in ./venv/lib/python2.7/site-packages (from minemeld-core==0.9.44)
Requirement already satisfied: beautifulsoup4==4.4.1 in ./venv/lib/python2.7/site-packages (from minemeld-core==0.9.44)
Requirement already satisfied: cifsdk==2.0.0b7 in ./venv/lib/python2.7/site-packages (from minemeld-core==0.9.44)
Requirement already satisfied: lz4==0.8.2 in ./venv/lib/python2.7/site-packages (from minemeld-core==0.9.44)
Requirement already satisfied: networkx==1.11 in ./venv/lib/python2.7/site-packages (from minemeld-core==0.9.44)
Requirement already satisfied: unicodecsv==0.14.1 in ./venv/lib/python2.7/site-packages (from minemeld-core==0.9.44)
Requirement already satisfied: pyOpenSSL; extra == "security" in ./venv/lib/python2.7/site-packages (from requests[security]==2.7.0->minemeld-core==0.9.44)
Requirement already satisfied: ndg-httpsclient; extra == "security" in ./venv/lib/python2.7/site-packages (from requests[security]==2.7.0->minemeld-core==0.9.44)
Requirement already satisfied: pyasn1; extra == "security" in ./venv/lib/python2.7/site-packages (from requests[security]==2.7.0->minemeld-core==0.9.44)
Requirement already satisfied: python-dateutil in ./venv/lib/python2.7/site-packages (from stix==1.1.1.6->minemeld-core==0.9.44)
Requirement already satisfied: lxml>=2.3 in ./venv/lib/python2.7/site-packages (from stix==1.1.1.6->minemeld-core==0.9.44)
Requirement already satisfied: six>=1.9.0 in ./venv/lib/python2.7/site-packages (from libtaxii==1.1.107->minemeld-core==0.9.44)
Requirement already satisfied: pytricia>=0.9.0 in ./venv/lib/python2.7/site-packages (from cifsdk==2.0.0b7->minemeld-core==0.9.44)
Requirement already satisfied: arrow>=0.6.0 in ./venv/lib/python2.7/site-packages (from cifsdk==2.0.0b7->minemeld-core==0.9.44)
Requirement already satisfied: ipaddress>=1.0.16 in ./venv/lib/python2.7/site-packages (from cifsdk==2.0.0b7->minemeld-core==0.9.44)
Requirement already satisfied: prettytable>=0.7.2 in ./venv/lib/python2.7/site-packages (from cifsdk==2.0.0b7->minemeld-core==0.9.44)
Requirement already satisfied: pytest>=2.7.0 in ./venv/lib/python2.7/site-packages (from cifsdk==2.0.0b7->minemeld-core==0.9.44)
Requirement already satisfied: decorator>=3.4.0 in ./venv/lib/python2.7/site-packages (from networkx==1.11->minemeld-core==0.9.44)
Requirement already satisfied: cryptography>=2.1.4 in ./venv/lib/python2.7/site-packages (from pyOpenSSL; extra == "security"->requests[security]==2.7.0->minemeld-core==0.9.44)
Requirement already satisfied: backports.functools-lru-cache==1.2.1 in ./venv/lib/python2.7/site-packages (from arrow>=0.6.0->cifsdk==2.0.0b7->minemeld-core==0.9.44)
Requirement already satisfied: attrs>=17.2.0 in ./venv/lib/python2.7/site-packages (from pytest>=2.7.0->cifsdk==2.0.0b7->minemeld-core==0.9.44)
Requirement already satisfied: pluggy<0.7,>=0.5 in ./venv/lib/python2.7/site-packages (from pytest>=2.7.0->cifsdk==2.0.0b7->minemeld-core==0.9.44)
Requirement already satisfied: funcsigs; python_version < "3.0" in ./venv/lib/python2.7/site-packages (from pytest>=2.7.0->cifsdk==2.0.0b7->minemeld-core==0.9.44)
Requirement already satisfied: setuptools in ./venv/lib/python2.7/site-packages (from pytest>=2.7.0->cifsdk==2.0.0b7->minemeld-core==0.9.44)
Requirement already satisfied: py>=1.5.0 in ./venv/lib/python2.7/site-packages (from pytest>=2.7.0->cifsdk==2.0.0b7->minemeld-core==0.9.44)
Requirement already satisfied: cffi>=1.7; platform_python_implementation != "PyPy" in ./venv/lib/python2.7/site-packages (from cryptography>=2.1.4->pyOpenSSL; extra == "security"->requests[security]==2.7.0->minemeld-core==0.9.44)
Requirement already satisfied: enum34; python_version < "3" in ./venv/lib/python2.7/site-packages (from cryptography>=2.1.4->pyOpenSSL; extra == "security"->requests[security]==2.7.0->minemeld-core==0.9.44)
Requirement already satisfied: idna>=2.1 in ./venv/lib/python2.7/site-packages (from cryptography>=2.1.4->pyOpenSSL; extra == "security"->requests[security]==2.7.0->minemeld-core==0.9.44)
Requirement already satisfied: asn1crypto>=0.21.0 in ./venv/lib/python2.7/site-packages (from cryptography>=2.1.4->pyOpenSSL; extra == "security"->requests[security]==2.7.0->minemeld-core==0.9.44)
Requirement already satisfied: pycparser in ./venv/lib/python2.7/site-packages (from cffi>=1.7; platform_python_implementation != "PyPy"->cryptography>=2.1.4->pyOpenSSL; extra == "security"->requests[security]==2.7.0->minemeld-core==0.9.44)
Installing collected packages: minemeld-core
  Running setup.py develop for minemeld-core
    Complete output from command /home/egk/git-reps/domainlists/venv/bin/python2 -c "import setuptools, tokenize;__file__='/home/egk/git-reps/minemeld-core/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" develop --no-deps:
    running develop
    running egg_info
    writing requirements to minemeld_core.egg-info/requires.txt
    writing minemeld_core.egg-info/PKG-INFO
    writing top-level names to minemeld_core.egg-info/top_level.txt
    writing dependency_links to minemeld_core.egg-info/dependency_links.txt
    writing entry points to minemeld_core.egg-info/entry_points.txt
    reading manifest file 'minemeld_core.egg-info/SOURCES.txt'
    writing manifest file 'minemeld_core.egg-info/SOURCES.txt'
    running build_ext
    building 'minemeld.packages.gdns._ares' extension
    x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fno-strict-aliasing -Wdate-time -D_FORTIFY_SOURCE=2 -g -fstack-protector-strong -Wformat -Werror=format-security -fPIC -DHAVE_NETDB_H= -I/usr/include/python2.7 -c minemeld/packages/gdns/_ares.c -o build/temp.linux-x86_64-2.7/minemeld/packages/gdns/_ares.o
    minemeld/packages/gdns/_ares.c:283:18: fatal error: ares.h: No such file or directory
    compilation terminated.
    error: command 'x86_64-linux-gnu-gcc' failed with exit status 1

    ----------------------------------------
Command "/home/egk/git-reps/domainlists/venv/bin/python2 -c "import setuptools, tokenize;__file__='/home/egk/git-reps/minemeld-core/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" develop --no-deps" failed with error code 1 in /home/egk/git-reps/minemeld-core/
kidmose commented 6 years ago

Workarround:

sudo apt-get install libc-ares-dev # Linux mint 18 (tested), likely also working for ubuntu and debian (Not tested)
yum install c-ares-devel # on Red Hat and CentOS (Not tested)

Is this me hacking arround the propper way of installing (ansible etc.) or is this actually a bug? I don't know. If someone can clarify this and point me in the right direction on how to fix, I'm happy to provide a PR.

sskadit commented 6 years ago

Its not working after that workaround !! I'm breaking my head over this a whole day! same error Its a bug can some one clarify this error ?

getting this error while running this command.

/opt/minemeld/engine/current/bin/pip install -e /opt/minemeld/engine/core

screen shot 2018-03-15 at 5 05 59 pm

wibergify commented 6 years ago

In order to build the ares library you need to have python-dev installed. While running setup.py it will build the ares library using the ares.pyx file.

LoganRoss747 commented 5 years ago

Trying to install on RHEL7 keep getting this.


fatal: [127.0.0.1]: FAILED! => {"changed": false, "cmd": ["/opt/minemeld/engine/current/bin/pip2", "install", "-r", "/opt/minemeld/engine/core/requirements.txt"], "msg": "stdout: Requirement already satisfied: pip>=9.0.1 in /opt/minemeld/engine/current/lib/python2.7/site-packages (from -r /opt/minemeld/engine/core/requirements.txt (line 1)) (18.1)\nRequirement already satisfied: amqp==1.4.6 in /opt/minemeld/engine/current/lib/python2.7/site-packages (from -r /opt/minemeld/engine/core/requirements.txt (line 2)) (1.4.6)\nCollecting gevent==1.0.2 (from -r /opt/minemeld/engine/core/requirements.txt (line 3))\n  Using cached https://files.pythonhosted.org/packages/8a/71/9bb13513d39c513fa71344d57a11affd6ccad775575458f435ff9142daf5/gevent-1.0.2.tar.gz\nRequirement already satisfied: greenlet==0.4.7 in /opt/minemeld/engine/current/lib/python2.7/site-packages (from -r /opt/minemeld/engine/core/requirements.txt (line 4)) (0.4.7)\nCollecting hiredis==0.2.0 (from -r /opt/minemeld/engine/core/requirements.txt (line 5))\n  Using cached https://files.pythonhosted.org/packages/52/93/3499eac0cbdc007496c6599d508cda76dc673ce69b6ae778008aa56bf14a/hiredis-0.2.0-cp27-cp27mu-manylinux1_x86_64.whl\nCollecting PyYAML==3.11 (from -r /opt/minemeld/engine/core/requirements.txt (line 6))\nCollecting redis==2.10.5 (from -r /opt/minemeld/engine/core/requirements.txt (line 7))\n  Using cached https://files.pythonhosted.org/packages/08/c1/457428f7507e27ba7144758a7b716ea35766e6d602f4a0c16e443ab3d381/redis-2.10.5-py2.py3-none-any.whl\nCollecting requests[security]==2.7.0 (from -r /opt/minemeld/engine/core/requirements.txt (line 8))\n  Using cached https://files.pythonhosted.org/packages/26/ff/c71b3943bebdd9f7ceb9e137296370587eb0b33fe2eb3732ae168bc45204/requests-2.7.0-py2.py3-none-any.whl\nCollecting plyvel==0.9 (from -r /opt/minemeld/engine/core/requirements.txt (line 9))\nCollecting netaddr==0.7.18 (from -r /opt/minemeld/engine/core/requirements.txt (line 10))\n  Using cached https://files.pythonhosted.org/packages/04/9c/46c719f026dc87822ccce2530049f3c0865e85307b7ab50beb28008e10c0/netaddr-0.7.18-py2.py3-none-any.whl\nCollecting antlr4-python2-runtime==4.5.2 (from -r /opt/minemeld/engine/core/requirements.txt (line 11))\nCollecting jmespath==0.7.1 (from -r /opt/minemeld/engine/core/requirements.txt (line 12))\n  Using cached https://files.pythonhosted.org/packages/1c/e7/c7381144a6c96d2641ab46c69384c02dcb491d8c8f7fc90cfb97cfdbe7cd/jmespath-0.7.1-py2.py3-none-any.whl\nCollecting click==4.1 (from -r /opt/minemeld/engine/core/requirements.txt (line 13))\n  Using cached https://files.pythonhosted.org/packages/6e/97/f25f4277d90efa3d34ced57137023ecb96e0c9aacf79b4f93efe6d94a2f8/click-4.1-py2.py3-none-any.whl\nCollecting pan-python==0.10.0 (from -r /opt/minemeld/engine/core/requirements.txt (line 14))\nCollecting stix==1.1.1.6 (from -r /opt/minemeld/engine/core/requirements.txt (line 15))\n  Using cached https://files.pythonhosted.org/packages/24/12/fa1abb528efb7aab9ac6f575e18ecb56a2169938d93398a1cf9c0cee5d93/stix-1.1.1.6-py2-none-any.whl\nCollecting cybox==2.1.0.12 (from -r /opt/minemeld/engine/core/requirements.txt (line 16))\nCollecting libtaxii==1.1.107 (from -r /opt/minemeld/engine/core/requirements.txt (line 17))\nCollecting pytz==2015.4 (from -r /opt/minemeld/engine/core/requirements.txt (line 18))\n  Using cached https://files.pythonhosted.org/packages/2d/cb/c9b0c9e4cf54bc3517b2d52904c9f328be2e88cf07392fea51ee0c3c4b28/pytz-2015.4-py2.py3-none-any.whl\nCollecting certifi (from -r /opt/minemeld/engine/core/requirements.txt (line 19))\n  Using cached https://files.pythonhosted.org/packages/9f/e0/accfc1b56b57e9750eba272e24c4dddeac86852c2bebd1236674d7887e8a/certifi-2018.11.29-py2.py3-none-any.whl\nCollecting ujson==1.34 (from -r /opt/minemeld/engine/core/requirements.txt (line 20))\nCollecting filelock==2.0.4 (from -r /opt/minemeld/engine/core/requirements.txt (line 21))\nCollecting sleekxmpp==1.3.1 (from -r /opt/minemeld/engine/core/requirements.txt (line 22))\nCollecting beautifulsoup4==4.4.1 (from -r /opt/minemeld/engine/core/requirements.txt (line 23))\n  Using cached https://files.pythonhosted.org/packages/33/62/f3e97eaa87fc4de0cb9b8c51d253cf0df621c6de6b25164dcbab203e5ff7/beautifulsoup4-4.4.1-py2-none-any.whl\nCollecting cifsdk==2.0.0b7 (from -r /opt/minemeld/engine/core/requirements.txt (line 24))\nCollecting lz4==0.8.2 (from -r /opt/minemeld/engine/core/requirements.txt (line 25))\nCollecting networkx==1.11 (from -r /opt/minemeld/engine/core/requirements.txt (line 26))\n  Using cached https://files.pythonhosted.org/packages/d3/2c/e473e54afc9fae58dfa97066ef6709a7e35a1dd1c28c5a3842989322be00/networkx-1.11-py2.py3-none-any.whl\nCollecting pyOpenSSL; extra == \"security\" (from requests[security]==2.7.0->-r /opt/minemeld/engine/core/requirements.txt (line 8))\n  Using cached https://files.pythonhosted.org/packages/96/af/9d29e6bd40823061aea2e0574ccb2fcf72bfd6130ce53d32773ec375458c/pyOpenSSL-18.0.0-py2.py3-none-any.whl\nCollecting ndg-httpsclient; extra == \"security\" (from requests[security]==2.7.0->-r /opt/minemeld/engine/core/requirements.txt (line 8))\n  Using cached https://files.pythonhosted.org/packages/bf/b2/26470fde7ff55169df8e071fb42cb1f83e22bd952520ab2b5c5a5edc2acd/ndg_httpsclient-0.5.1-py2-none-any.whl\nCollecting pyasn1; extra == \"security\" (from requests[security]==2.7.0->-r /opt/minemeld/engine/core/requirements.txt (line 8))\n  Using cached https://files.pythonhosted.org/packages/7b/7c/c9386b82a25115cccf1903441bba3cbadcfae7b678a20167347fa8ded34c/pyasn1-0.4.5-py2.py3-none-any.whl\nCollecting lxml>=2.3 (from stix==1.1.1.6->-r /opt/minemeld/engine/core/requirements.txt (line 15))\n  Using cached https://files.pythonhosted.org/packages/11/46/186f3fe9e7101c79d946497386f82f7be223515ccfa3caa21a6ffa62b2aa/lxml-4.3.0-cp27-cp27mu-manylinux1_x86_64.whl\nCollecting python-dateutil (from stix==1.1.1.6->-r /opt/minemeld/engine/core/requirements.txt (line 15))\n  Using cached https://files.pythonhosted.org/packages/74/68/d87d9b36af36f44254a8d512cbfc48369103a3b9e474be9bdfe536abfc45/python_dateutil-2.7.5-py2.py3-none-any.whl\nCollecting six>=1.9.0 (from libtaxii==1.1.107->-r /opt/minemeld/engine/core/requirements.txt (line 17))\n  Using cached https://files.pythonhosted.org/packages/73/fb/00a976f728d0d1fecfe898238ce23f502a721c0ac0ecfedb80e0d88c64e9/six-1.12.0-py2.py3-none-any.whl\nCollecting prettytable>=0.7.2 (from cifsdk==2.0.0b7->-r /opt/minemeld/engine/core/requirements.txt (line 24))\nCollecting ipaddress>=1.0.16 (from cifsdk==2.0.0b7->-r /opt/minemeld/engine/core/requirements.txt (line 24))\n  Using cached https://files.pythonhosted.org/packages/fc/d0/7fc3a811e011d4b388be48a0e381db8d990042df54aa4ef4599a31d39853/ipaddress-1.0.22-py2.py3-none-any.whl\nCollecting pytricia>=0.9.0 (from cifsdk==2.0.0b7->-r /opt/minemeld/engine/core/requirements.txt (line 24))\nCollecting arrow>=0.6.0 (from cifsdk==2.0.0b7->-r /opt/minemeld/engine/core/requirements.txt (line 24))\nCollecting pytest>=2.7.0 (from cifsdk==2.0.0b7->-r /opt/minemeld/engine/core/requirements.txt (line 24))\n  Using cached https://files.pythonhosted.org/packages/95/6a/4122affe57eb3857874ef959a73f362e51b23812b96c92e073b16e1effd0/pytest-4.1.0-py2.py3-none-any.whl\nCollecting decorator>=3.4.0 (from networkx==1.11->-r /opt/minemeld/engine/core/requirements.txt (line 26))\n  Using cached https://files.pythonhosted.org/packages/bc/bb/a24838832ba35baf52f32ab1a49b906b5f82fb7c76b2f6a7e35e140bac30/decorator-4.3.0-py2.py3-none-any.whl\nCollecting cryptography>=2.2.1 (from pyOpenSSL; extra == \"security\"->requests[security]==2.7.0->-r /opt/minemeld/engine/core/requirements.txt (line 8))\n  Using cached https://files.pythonhosted.org/packages/7f/ba/383b51cc26e3141c689ce988814385c7659f5ba01c4b5f2de38233010b5f/cryptography-2.4.2-cp27-cp27mu-manylinux1_x86_64.whl\nCollecting backports.functools-lru-cache>=1.2.1; python_version == \"2.7\" (from arrow>=0.6.0->cifsdk==2.0.0b7->-r /opt/minemeld/engine/core/requirements.txt (line 24))\n  Using cached https://files.pythonhosted.org/packages/03/8e/2424c0e65c4a066e28f539364deee49b6451f8fcd4f718fefa50cc3dcf48/backports.functools_lru_cache-1.5-py2.py3-none-any.whl\nCollecting atomicwrites>=1.0 (from pytest>=2.7.0->cifsdk==2.0.0b7->-r /opt/minemeld/engine/core/requirements.txt (line 24))\n  Using cached https://files.pythonhosted.org/packages/3a/9a/9d878f8d885706e2530402de6417141129a943802c084238914fa6798d97/atomicwrites-1.2.1-py2.py3-none-any.whl\nCollecting more-itertools>=4.0.0 (from pytest>=2.7.0->cifsdk==2.0.0b7->-r /opt/minemeld/engine/core/requirements.txt (line 24))\n  Using cached https://files.pythonhosted.org/packages/2f/9d/dcfe59e213093695f108508af1214cf9cd95cc5489e46877ec5cb56369e5/more_itertools-5.0.0-py2-none-any.whl\nCollecting pluggy>=0.7 (from pytest>=2.7.0->cifsdk==2.0.0b7->-r /opt/minemeld/engine/core/requirements.txt (line 24))\n  Using cached https://files.pythonhosted.org/packages/2d/60/f58d9e8197f911f9405bf7e02227b43a2acc2c2f1a8cbb1be5ecf6bfd0b8/pluggy-0.8.1-py2.py3-none-any.whl\nRequirement already satisfied: setuptools in /opt/minemeld/engine/current/lib/python2.7/site-packages (from pytest>=2.7.0->cifsdk==2.0.0b7->-r /opt/minemeld/engine/core/requirements.txt (line 24)) (40.6.3)\nCollecting attrs>=17.4.0 (from pytest>=2.7.0->cifsdk==2.0.0b7->-r /opt/minemeld/engine/core/requirements.txt (line 24))\n  Using cached https://files.pythonhosted.org/packages/3a/e1/5f9023cc983f1a628a8c2fd051ad19e76ff7b142a0faf329336f9a62a514/attrs-18.2.0-py2.py3-none-any.whl\nCollecting pathlib2>=2.2.0; python_version < \"3.6\" (from pytest>=2.7.0->cifsdk==2.0.0b7->-r /opt/minemeld/engine/core/requirements.txt (line 24))\n  Using cached https://files.pythonhosted.org/packages/2a/46/c696dcf1c7aad917b39b875acdc5451975e3a9b4890dca8329983201c97a/pathlib2-2.3.3-py2.py3-none-any.whl\nCollecting py>=1.5.0 (from pytest>=2.7.0->cifsdk==2.0.0b7->-r /opt/minemeld/engine/core/requirements.txt (line 24))\n  Using cached https://files.pythonhosted.org/packages/3e/c7/3da685ef117d42ac8d71af525208759742dd235f8094221fdaafcd3dba8f/py-1.7.0-py2.py3-none-any.whl\nCollecting funcsigs; python_version < \"3.0\" (from pytest>=2.7.0->cifsdk==2.0.0b7->-r /opt/minemeld/engine/core/requirements.txt (line 24))\n  Using cached https://files.pythonhosted.org/packages/69/cb/f5be453359271714c01b9bd06126eaf2e368f1fddfff30818754b5ac2328/funcsigs-1.0.2-py2.py3-none-any.whl\nCollecting idna>=2.1 (from cryptography>=2.2.1->pyOpenSSL; extra == \"security\"->requests[security]==2.7.0->-r /opt/minemeld/engine/core/requirements.txt (line 8))\n  Using cached https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl\nCollecting enum34; python_version < \"3\" (from cryptography>=2.2.1->pyOpenSSL; extra == \"security\"->requests[security]==2.7.0->-r /opt/minemeld/engine/core/requirements.txt (line 8))\n  Using cached https://files.pythonhosted.org/packages/c5/db/e56e6b4bbac7c4a06de1c50de6fe1ef3810018ae11732a50f15f62c7d050/enum34-1.1.6-py2-none-any.whl\nCollecting cffi!=1.11.3,>=1.7 (from cryptography>=2.2.1->pyOpenSSL; extra == \"security\"->requests[security]==2.7.0->-r /opt/minemeld/engine/core/requirements.txt (line 8))\n  Using cached https://files.pythonhosted.org/packages/14/dd/3e7a1e1280e7d767bd3fa15791759c91ec19058ebe31217fe66f3e9a8c49/cffi-1.11.5-cp27-cp27mu-manylinux1_x86_64.whl\nCollecting asn1crypto>=0.21.0 (from cryptography>=2.2.1->pyOpenSSL; extra == \"security\"->requests[security]==2.7.0->-r /opt/minemeld/engine/core/requirements.txt (line 8))\n  Using cached https://files.pythonhosted.org/packages/ea/cd/35485615f45f30a510576f1a56d1e0a7ad7bd8ab5ed7cdc600ef7cd06222/asn1crypto-0.24.0-py2.py3-none-any.whl\nCollecting scandir; python_version < \"3.5\" (from pathlib2>=2.2.0; python_version < \"3.6\"->pytest>=2.7.0->cifsdk==2.0.0b7->-r /opt/minemeld/engine/core/requirements.txt (line 24))\nCollecting pycparser (from cffi!=1.11.3,>=1.7->cryptography>=2.2.1->pyOpenSSL; extra == \"security\"->requests[security]==2.7.0->-r /opt/minemeld/engine/core/requirements.txt (line 8))\nBuilding wheels for collected packages: gevent\n  Running setup.py bdist_wheel for gevent: started\n  Running setup.py bdist_wheel for gevent: finished with status 'error'\n  Complete output from command /opt/minemeld/engine/current/bin/python2.7 -u -c \"import setuptools, tokenize;__file__='/tmp/pip-install-_SxmK1/gevent/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\\r\\n', '\\n');f.close();exec(compile(code, __file__, 'exec'))\" bdist_wheel -d /tmp/pip-wheel-79busf --python-tag cp27:\n  running bdist_wheel\n  running build\n  running build_py\n  creating build\n  creating build/lib.linux-x86_64-2.7\n  creating build/lib.linux-x86_64-2.7/gevent\n  copying gevent/__init__.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/_ssl2.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/_sslgte279.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/_threading.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/backdoor.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/baseserver.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/coros.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/event.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/fileobject.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/greenlet.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/hub.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/local.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/lock.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/monkey.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/os.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/pool.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/pywsgi.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/queue.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/resolver_ares.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/resolver_thread.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/select.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/server.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/socket.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/ssl.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/subprocess.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/thread.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/threading.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/threadpool.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/timeout.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/util.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/win32util.py -> build/lib.linux-x86_64-2.7/gevent\n  copying gevent/wsgi.py -> build/lib.linux-x86_64-2.7/gevent\n  running build_ext\n  Running '/bin/sh /tmp/pip-install-_SxmK1/gevent/libev/configure > configure-output.txt' in /tmp/pip-install-_SxmK1/gevent/build/temp.linux-x86_64-2.7/libev\n  configure: error: in `/tmp/pip-install-_SxmK1/gevent/build/temp.linux-x86_64-2.7/libev':\n  configure: error: cannot run C compiled programs.\n  If you meant to cross compile, use `--host'.\n  See `config.log' for more details\n  building 'gevent.core' extension\n  creating build/temp.linux-x86_64-2.7/gevent\n  gcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -DLIBEV_EMBED=1 -DEV_COMMON= -DEV_CLEANUP_ENABLE=0 -DEV_EMBED_ENABLE=0 -DEV_PERIODIC_ENABLE=0 -Ibuild/temp.linux-x86_64-2.7/libev -Ilibev -I/usr/include/python2.7 -c gevent/gevent.core.c -o build/temp.linux-x86_64-2.7/gevent/gevent.core.o\n  In file included from gevent/libev.h:2:0,\n                   from gevent/gevent.core.c:249:\n  libev/ev.c:45:22: fatal error: config.h: No such file or directory\n   #  include \"config.h\"\n                        ^\n  compilation terminated.\n  error: command 'gcc' failed with exit status 1\n  \n  ----------------------------------------\n  Running setup.py clean for gevent\nFailed to build gevent\nInstalling collected packages: gevent, hiredis, PyYAML, redis, idna, enum34, six, pycparser, cffi, asn1crypto, ipaddress, cryptography, pyOpenSSL, pyasn1, ndg-httpsclient, requests, plyvel, netaddr, antlr4-python2-runtime, jmespath, click, pan-python, lxml, python-dateutil, cybox, stix, libtaxii, pytz, certifi, ujson, filelock, sleekxmpp, beautifulsoup4, prettytable, pytricia, backports.functools-lru-cache, arrow, atomicwrites, more-itertools, pluggy, attrs, scandir, pathlib2, py, funcsigs, pytest, cifsdk, lz4, decorator, networkx\n  Running setup.py install for gevent: started\n    Running setup.py install for gevent: finished with status 'error'\n    Complete output from command /opt/minemeld/engine/current/bin/python2.7 -u -c \"import setuptools, tokenize;__file__='/tmp/pip-install-_SxmK1/gevent/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\\r\\n', '\\n');f.close();exec(compile(code, __file__, 'exec'))\" install --record /tmp/pip-record-FuKqR0/install-record.txt --single-version-externally-managed --compile --install-headers /opt/minemeld/engine/current/include/site/python2.7/gevent:\n    running install\n    running build\n    running build_py\n    creating build\n    creating build/lib.linux-x86_64-2.7\n    creating build/lib.linux-x86_64-2.7/gevent\n    copying gevent/__init__.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/_ssl2.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/_sslgte279.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/_threading.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/backdoor.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/baseserver.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/coros.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/event.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/fileobject.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/greenlet.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/hub.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/local.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/lock.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/monkey.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/os.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/pool.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/pywsgi.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/queue.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/resolver_ares.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/resolver_thread.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/select.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/server.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/socket.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/ssl.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/subprocess.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/thread.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/threading.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/threadpool.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/timeout.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/util.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/win32util.py -> build/lib.linux-x86_64-2.7/gevent\n    copying gevent/wsgi.py -> build/lib.linux-x86_64-2.7/gevent\n    running build_ext\n    Running '/bin/sh /tmp/pip-install-_SxmK1/gevent/libev/configure > configure-output.txt' in /tmp/pip-install-_SxmK1/gevent/build/temp.linux-x86_64-2.7/libev\n    configure: error: in `/tmp/pip-install-_SxmK1/gevent/build/temp.linux-x86_64-2.7/libev':\n    configure: error: cannot run C compiled programs.\n    If you meant to cross compile, use `--host'.\n    See `config.log' for more details\n    building 'gevent.core' extension\n    creating build/temp.linux-x86_64-2.7/gevent\n    gcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -DLIBEV_EMBED=1 -DEV_COMMON= -DEV_CLEANUP_ENABLE=0 -DEV_EMBED_ENABLE=0 -DEV_PERIODIC_ENABLE=0 -Ibuild/temp.linux-x86_64-2.7/libev -Ilibev -I/usr/include/python2.7 -c gevent/gevent.core.c -o build/temp.linux-x86_64-2.7/gevent/gevent.core.o\n    In file included from gevent/libev.h:2:0,\n                     from gevent/gevent.core.c:249:\n    libev/ev.c:45:22: fatal error: config.h: No such file or directory\n     #  include \"config.h\"\n                          ^\n    compilation terminated.\n    error: command 'gcc' failed with exit status 1\n    \n    ----------------------------------------\n\n:stderr:   Failed building wheel for gevent\nCommand \"/opt/minemeld/engine/current/bin/python2.7 -u -c \"import setuptools, tokenize;__file__='/tmp/pip-install-_SxmK1/gevent/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\\r\\n', '\\n');f.close();exec(compile(code, __file__, 'exec'))\" install --record /tmp/pip-record-FuKqR0/install-record.txt --single-version-externally-managed --compile --install-headers /opt/minemeld/engine/current/include/site/python2.7/gevent\" failed with error code 1 in /tmp/pip-install-_SxmK1/gevent/\n"}
        to retry, use: --limit @/home/T2213221-SVA/minemeld-ansible/local.retry

PLAY RECAP ***************************************************************************************************************************************************************************************************
127.0.0.1                  : ok=37   changed=2    unreachable=0    failed=1   ```
sarfarazahmad89 commented 5 years ago

I had to manually cythonize the file. With cythonize _ares.pyx this creates a _ares.c

I don't know (Haven't bothered to investigate in detail) what is breaking with python setup.py or pip install. Relevant doc at : https://cython.readthedocs.io/en/latest/src/quickstart/build.html