Closed flynn1973 closed 2 years ago
The error messages provided don't provide enough context here unfortunately. It does appear that cffi
is failing to properly install, which is a dependency cryptography
needs both at build and runtime. I'm not sure where the >=3.7 is coming from though. We test 3.6 and all our deps in CI, albeit not on ppc64le, but that shouldn't be a factor for Python version support.
It's coming from setuptools installation attempt. 59.7 requires Python >= 3.7.
Which merely changes the question to "why is pip trying to user that version"?
What version of pip is /var/lib/awx/venv/aix-custom-venv/bin/pip
pip version in venv:
(aix-custom-venv) root@lpgaixmgmtlx01:/var/lib/awx/venv/aix-custom-venv>pip -V
pip 21.3.1 from /var/lib/awx/venv/aix-custom-venv/lib/python3.6/site-packages/pip (python 3.6)
cffi is installed in venv:
(aix-custom-venv) root@lpgaixmgmtlx01:/var/lib/awx/venv/aix-custom-venv>pip list --local
Package Version
---------------- -------
asn1crypto 1.5.1
cffi 1.15.0
idna 3.3
Jinja2 2.11.3
MarkupSafe 1.1.1
packaging 21.3
pip 21.3.1
psutil 5.9.0
pycparser 2.21
PyMySQL 1.0.2
pyparsing 3.0.7
python-memcached 1.59
PyYAML 6.0
resolvelib 0.5.4
setuptools 28.8.0
six 1.16.0
wheel 0.29.0
the full error in all its uglyness
(aix-custom-venv) root@lpgaixmgmtlx01:/var/lib/awx/venv/aix-custom-venv>pip install cryptography --no-binary cryptography
Collecting cryptography
Using cached cryptography-36.0.2.tar.gz (572 kB)
Installing build dependencies ... done
Getting requirements to build wheel ... error
ERROR: Command errored out with exit status 1:
command: /var/lib/awx/venv/aix-custom-venv/bin/python3 /var/lib/awx/venv/aix-custom-venv/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py get_requires_for_build_wheel /tmp/tmps2wncr3b
cwd: /tmp/pip-install-6r8kih69/cryptography_a4648831b6264bc78eab0d3b6107e3e1
Complete output (62 lines):
=============================DEBUG ASSISTANCE=============================
If you are seeing a compilation error please try the following steps to
successfully install cryptography:
1) Upgrade to the latest pip and try again. This will fix errors for most
users. See: https://pip.pypa.io/en/stable/installing/#upgrading-pip
2) Read https://cryptography.io/en/latest/installation/ for specific
instructions for your platform.
3) Check our frequently asked questions for more information:
https://cryptography.io/en/latest/faq/
4) Ensure you have a recent Rust toolchain installed:
https://cryptography.io/en/latest/installation/#rust
Python: 3.6.12
platform: Linux-3.10.0-1160.49.1.el7.ppc64le-ppc64le-with-redhat-7.9-Maipo
pip: n/a
setuptools: 59.6.0
setuptools_rust: 1.1.2
=============================DEBUG ASSISTANCE=============================
Traceback (most recent call last):
File "/var/lib/awx/venv/aix-custom-venv/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 363, in <module>
main()
File "/var/lib/awx/venv/aix-custom-venv/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 345, in main
json_out['return_val'] = hook(**hook_input['kwargs'])
File "/var/lib/awx/venv/aix-custom-venv/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 130, in get_requires_for_build_wheel
return hook(config_settings)
File "/tmp/pip-build-env-g_1cj935/overlay/lib/python3.6/site-packages/setuptools/build_meta.py", line 163, in get_requires_for_build_wheel
config_settings, requirements=['wheel'])
File "/tmp/pip-build-env-g_1cj935/overlay/lib/python3.6/site-packages/setuptools/build_meta.py", line 143, in _get_build_requires
self.run_setup()
File "/tmp/pip-build-env-g_1cj935/overlay/lib/python3.6/site-packages/setuptools/build_meta.py", line 158, in run_setup
exec(compile(code, __file__, 'exec'), locals())
File "setup.py", line 54, in <module>
rust_version=">=1.41.0",
File "/tmp/pip-build-env-g_1cj935/overlay/lib/python3.6/site-packages/setuptools/__init__.py", line 153, in setup
return distutils.core.setup(**attrs)
File "/opt/rh/rh-python36/root/usr/lib64/python3.6/distutils/core.py", line 108, in setup
_setup_distribution = dist = klass(attrs)
File "/tmp/pip-build-env-g_1cj935/overlay/lib/python3.6/site-packages/setuptools/dist.py", line 463, in __init__
for k, v in attrs.items()
File "/opt/rh/rh-python36/root/usr/lib64/python3.6/distutils/dist.py", line 281, in __init__
self.finalize_options()
File "/tmp/pip-build-env-g_1cj935/overlay/lib/python3.6/site-packages/setuptools/dist.py", line 837, in finalize_options
ep(self)
File "/tmp/pip-build-env-g_1cj935/overlay/lib/python3.6/site-packages/setuptools/dist.py", line 858, in _finalize_setup_keywords
ep.load()(self, ep.name, value)
File "/tmp/pip-build-env-g_1cj935/overlay/lib64/python3.6/site-packages/cffi/setuptools_ext.py", line 219, in cffi_modules
add_cffi_module(dist, cffi_module)
File "/tmp/pip-build-env-g_1cj935/overlay/lib64/python3.6/site-packages/cffi/setuptools_ext.py", line 49, in add_cffi_module
execfile(build_file_name, mod_vars)
File "/tmp/pip-build-env-g_1cj935/overlay/lib64/python3.6/site-packages/cffi/setuptools_ext.py", line 25, in execfile
exec(code, glob, glob)
File "src/_cffi_src/build_openssl.py", line 118, in <module>
extra_link_args=extra_link_args(compiler_type()),
File "src/_cffi_src/utils.py", line 59, in build_ffi_for_binding
extra_link_args=extra_link_args,
File "src/_cffi_src/utils.py", line 73, in build_ffi
ffi = FFI()
File "/tmp/pip-build-env-g_1cj935/overlay/lib64/python3.6/site-packages/cffi/api.py", line 48, in __init__
import _cffi_backend as backend
ModuleNotFoundError: No module named '_cffi_backend'
----------------------------------------
WARNING: Discarding https://files.pythonhosted.org/packages/10/a7/51953e73828deef2b58ba1604de9167843ee9cd4185d8aaffcb45dd1932d/cryptography-36.0.2.tar.gz#sha256=70f8f4f7bb2ac9f340655cbac89d68c527af5bb4387522a8413e841e3e6628c9 (from https://pypi.org/simple/cryptography/) (requires-python:>=3.6). Command errored out with exit status 1: /var/lib/awx/venv/aix-custom-venv/bin/python3 /var/lib/awx/venv/aix-custom-venv/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py get_requires_for_build_wheel /tmp/tmps2wncr3b Check the logs for full command output.
another attempt with build script also failed...
#!/bin/bash
# run like this...
# scl enable rh-python36 "./build.sh 36.0.2"
git clone https://github.com/pyca/cryptography.git
cd ./cryptography/
export VERSION=$1
git checkout tags/$VERSION
python3 -m venv cryptography-venv
pip3 install --upgrade pip
pip3 install --editable .
pip3 install --requirement dev-requirements.txt
python3 ./setup.py build
python3 ./setup.py bdist_wheel
root@lpgaixmgmtlx01:/scratch/sink/python_crypography_build>scl enable rh-python36 "./build.sh 36.0.2"
Cloning into 'cryptography'...
remote: Enumerating objects: 64537, done.
remote: Counting objects: 100% (1364/1364), done.
remote: Compressing objects: 100% (581/581), done.
remote: Total 64537 (delta 863), reused 1171 (delta 772), pack-reused 63173
Receiving objects: 100% (64537/64537), 50.37 MiB | 9.41 MiB/s, done.
Resolving deltas: 100% (44086/44086), done.
Checking connectivity... done.
Note: checking out 'tags/36.0.2'.
You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by performing another checkout.
If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -b with the checkout command again. Example:
git checkout -b <new-branch-name>
HEAD is now at df06889... version bump and changelog (#6964)
Cache entry deserialization failed, entry ignored
Collecting pip
Downloading https://files.pythonhosted.org/packages/a4/6d/6463d49a933f547439d6b5b98b46af8742cc03ae83543e4d7688c2420f8b/pip-21.3.1-py3-none-any.whl (1.7MB)
100% |████████████████████████████████| 1.7MB 677kB/s
Installing collected packages: pip
Found existing installation: pip 9.0.1
Uninstalling pip-9.0.1:
Successfully uninstalled pip-9.0.1
Successfully installed pip-21.3.1
You are using pip version 21.3.1, however version 22.0.4 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
Obtaining file:///scratch/sink/python_crypography_build/cryptography
Installing build dependencies ... done
Checking if build backend supports build_editable ... done
Getting requirements to build wheel ... error
ERROR: Command errored out with exit status 1:
command: /opt/rh/rh-python36/root/usr/bin/python3 /opt/rh/rh-python36/root/usr/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py get_requires_for_build_wheel /tmp/tmpeyxbc74g
cwd: /scratch/sink/python_crypography_build/cryptography
Complete output (62 lines):
=============================DEBUG ASSISTANCE=============================
If you are seeing a compilation error please try the following steps to
successfully install cryptography:
1) Upgrade to the latest pip and try again. This will fix errors for most
users. See: https://pip.pypa.io/en/stable/installing/#upgrading-pip
2) Read https://cryptography.io/en/latest/installation/ for specific
instructions for your platform.
3) Check our frequently asked questions for more information:
https://cryptography.io/en/latest/faq/
4) Ensure you have a recent Rust toolchain installed:
https://cryptography.io/en/latest/installation/#rust
Python: 3.6.12
platform: Linux-3.10.0-1160.49.1.el7.ppc64le-ppc64le-with-redhat-7.9-Maipo
pip: n/a
setuptools: 59.6.0
setuptools_rust: 1.1.2
=============================DEBUG ASSISTANCE=============================
Traceback (most recent call last):
File "/opt/rh/rh-python36/root/usr/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 363, in <module>
main()
File "/opt/rh/rh-python36/root/usr/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 345, in main
json_out['return_val'] = hook(**hook_input['kwargs'])
File "/opt/rh/rh-python36/root/usr/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 130, in get_requires_for_build_wheel
return hook(config_settings)
File "/tmp/pip-build-env-h1wxc5d6/overlay/lib/python3.6/site-packages/setuptools/build_meta.py", line 163, in get_requires_for_build_wheel
config_settings, requirements=['wheel'])
File "/tmp/pip-build-env-h1wxc5d6/overlay/lib/python3.6/site-packages/setuptools/build_meta.py", line 143, in _get_build_requires
self.run_setup()
File "/tmp/pip-build-env-h1wxc5d6/overlay/lib/python3.6/site-packages/setuptools/build_meta.py", line 158, in run_setup
exec(compile(code, __file__, 'exec'), locals())
File "setup.py", line 54, in <module>
rust_version=">=1.41.0",
File "/tmp/pip-build-env-h1wxc5d6/overlay/lib/python3.6/site-packages/setuptools/__init__.py", line 153, in setup
return distutils.core.setup(**attrs)
File "/opt/rh/rh-python36/root/usr/lib64/python3.6/distutils/core.py", line 108, in setup
_setup_distribution = dist = klass(attrs)
File "/tmp/pip-build-env-h1wxc5d6/overlay/lib/python3.6/site-packages/setuptools/dist.py", line 463, in __init__
for k, v in attrs.items()
File "/opt/rh/rh-python36/root/usr/lib64/python3.6/distutils/dist.py", line 281, in __init__
self.finalize_options()
File "/tmp/pip-build-env-h1wxc5d6/overlay/lib/python3.6/site-packages/setuptools/dist.py", line 837, in finalize_options
ep(self)
File "/tmp/pip-build-env-h1wxc5d6/overlay/lib/python3.6/site-packages/setuptools/dist.py", line 858, in _finalize_setup_keywords
ep.load()(self, ep.name, value)
File "/tmp/pip-build-env-h1wxc5d6/overlay/lib64/python3.6/site-packages/cffi/setuptools_ext.py", line 219, in cffi_modules
add_cffi_module(dist, cffi_module)
File "/tmp/pip-build-env-h1wxc5d6/overlay/lib64/python3.6/site-packages/cffi/setuptools_ext.py", line 49, in add_cffi_module
execfile(build_file_name, mod_vars)
File "/tmp/pip-build-env-h1wxc5d6/overlay/lib64/python3.6/site-packages/cffi/setuptools_ext.py", line 25, in execfile
exec(code, glob, glob)
File "src/_cffi_src/build_openssl.py", line 118, in <module>
extra_link_args=extra_link_args(compiler_type()),
File "src/_cffi_src/utils.py", line 59, in build_ffi_for_binding
extra_link_args=extra_link_args,
File "src/_cffi_src/utils.py", line 73, in build_ffi
ffi = FFI()
File "/tmp/pip-build-env-h1wxc5d6/overlay/lib64/python3.6/site-packages/cffi/api.py", line 48, in __init__
import _cffi_backend as backend
ModuleNotFoundError: No module named '_cffi_backend'
----------------------------------------
WARNING: Discarding file:///scratch/sink/python_crypography_build/cryptography. Command errored out with exit status 1: /opt/rh/rh-python36/root/usr/bin/python3 /opt/rh/rh-python36/root/usr/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py get_requires_for_build_wheel /tmp/tmpeyxbc74g Check the logs for full command output.
ERROR: Command errored out with exit status 1: /opt/rh/rh-python36/root/usr/bin/python3 /opt/rh/rh-python36/root/usr/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py get_requires_for_build_wheel /tmp/tmpeyxbc74g Check the logs for full command output.
Obtaining file:///scratch/sink/python_crypography_build/cryptography (from -r dev-requirements.txt (line 5))
Installing build dependencies ... done
Checking if build backend supports build_editable ... done
Getting requirements to build wheel ... error
ERROR: Command errored out with exit status 1:
command: /opt/rh/rh-python36/root/usr/bin/python3 /opt/rh/rh-python36/root/usr/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py get_requires_for_build_wheel /tmp/tmpaidoes6f
cwd: /scratch/sink/python_crypography_build/cryptography
Complete output (62 lines):
=============================DEBUG ASSISTANCE=============================
If you are seeing a compilation error please try the following steps to
successfully install cryptography:
1) Upgrade to the latest pip and try again. This will fix errors for most
users. See: https://pip.pypa.io/en/stable/installing/#upgrading-pip
2) Read https://cryptography.io/en/latest/installation/ for specific
instructions for your platform.
3) Check our frequently asked questions for more information:
https://cryptography.io/en/latest/faq/
4) Ensure you have a recent Rust toolchain installed:
https://cryptography.io/en/latest/installation/#rust
Python: 3.6.12
platform: Linux-3.10.0-1160.49.1.el7.ppc64le-ppc64le-with-redhat-7.9-Maipo
pip: n/a
setuptools: 59.6.0
setuptools_rust: 1.1.2
=============================DEBUG ASSISTANCE=============================
Traceback (most recent call last):
File "/opt/rh/rh-python36/root/usr/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 363, in <module>
main()
File "/opt/rh/rh-python36/root/usr/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 345, in main
json_out['return_val'] = hook(**hook_input['kwargs'])
File "/opt/rh/rh-python36/root/usr/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 130, in get_requires_for_build_wheel
return hook(config_settings)
File "/tmp/pip-build-env-dg8abd8k/overlay/lib/python3.6/site-packages/setuptools/build_meta.py", line 163, in get_requires_for_build_wheel
config_settings, requirements=['wheel'])
File "/tmp/pip-build-env-dg8abd8k/overlay/lib/python3.6/site-packages/setuptools/build_meta.py", line 143, in _get_build_requires
self.run_setup()
File "/tmp/pip-build-env-dg8abd8k/overlay/lib/python3.6/site-packages/setuptools/build_meta.py", line 158, in run_setup
exec(compile(code, __file__, 'exec'), locals())
File "setup.py", line 54, in <module>
rust_version=">=1.41.0",
File "/tmp/pip-build-env-dg8abd8k/overlay/lib/python3.6/site-packages/setuptools/__init__.py", line 153, in setup
return distutils.core.setup(**attrs)
File "/opt/rh/rh-python36/root/usr/lib64/python3.6/distutils/core.py", line 108, in setup
_setup_distribution = dist = klass(attrs)
File "/tmp/pip-build-env-dg8abd8k/overlay/lib/python3.6/site-packages/setuptools/dist.py", line 463, in __init__
for k, v in attrs.items()
File "/opt/rh/rh-python36/root/usr/lib64/python3.6/distutils/dist.py", line 281, in __init__
self.finalize_options()
File "/tmp/pip-build-env-dg8abd8k/overlay/lib/python3.6/site-packages/setuptools/dist.py", line 837, in finalize_options
ep(self)
File "/tmp/pip-build-env-dg8abd8k/overlay/lib/python3.6/site-packages/setuptools/dist.py", line 858, in _finalize_setup_keywords
ep.load()(self, ep.name, value)
File "/tmp/pip-build-env-dg8abd8k/overlay/lib64/python3.6/site-packages/cffi/setuptools_ext.py", line 219, in cffi_modules
add_cffi_module(dist, cffi_module)
File "/tmp/pip-build-env-dg8abd8k/overlay/lib64/python3.6/site-packages/cffi/setuptools_ext.py", line 49, in add_cffi_module
execfile(build_file_name, mod_vars)
File "/tmp/pip-build-env-dg8abd8k/overlay/lib64/python3.6/site-packages/cffi/setuptools_ext.py", line 25, in execfile
exec(code, glob, glob)
File "src/_cffi_src/build_openssl.py", line 118, in <module>
extra_link_args=extra_link_args(compiler_type()),
File "src/_cffi_src/utils.py", line 59, in build_ffi_for_binding
extra_link_args=extra_link_args,
File "src/_cffi_src/utils.py", line 73, in build_ffi
ffi = FFI()
File "/tmp/pip-build-env-dg8abd8k/overlay/lib64/python3.6/site-packages/cffi/api.py", line 48, in __init__
import _cffi_backend as backend
ModuleNotFoundError: No module named '_cffi_backend'
----------------------------------------
WARNING: Discarding file:///scratch/sink/python_crypography_build/cryptography. Command errored out with exit status 1: /opt/rh/rh-python36/root/usr/bin/python3 /opt/rh/rh-python36/root/usr/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py get_requires_for_build_wheel /tmp/tmpaidoes6f Check the logs for full command output.
ERROR: Command errored out with exit status 1: /opt/rh/rh-python36/root/usr/bin/python3 /opt/rh/rh-python36/root/usr/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py get_requires_for_build_wheel /tmp/tmpaidoes6f Check the logs for full command output.
=============================DEBUG ASSISTANCE==========================
If you are seeing an error here please try the following to
successfully install cryptography:
Upgrade to the latest pip and try again. This will fix errors for most
users. See: https://pip.pypa.io/en/stable/installing/#upgrading-pip
=============================DEBUG ASSISTANCE==========================
Traceback (most recent call last):
File "./setup.py", line 14, in <module>
from setuptools_rust import RustExtension
ModuleNotFoundError: No module named 'setuptools_rust'
=============================DEBUG ASSISTANCE==========================
If you are seeing an error here please try the following to
successfully install cryptography:
Upgrade to the latest pip and try again. This will fix errors for most
users. See: https://pip.pypa.io/en/stable/installing/#upgrading-pip
=============================DEBUG ASSISTANCE==========================
Traceback (most recent call last):
File "./setup.py", line 14, in <module>
from setuptools_rust import RustExtension
ModuleNotFoundError: No module named 'setuptools_rust'
To me this looks like somehow your CFFI installation is broken. My suggestion would be to clear out your wheel cache, which I suspect contains a corrupted cffi wheel or something like that.
no wheels in cache...
(cryptography-venv) root@lpgaixmgmtlx01:/scratch/sink/python_crypography_build/cryptography/cryptography-venv>pip cache info
Package index page cache location: /root/.cache/pip/http
Package index page cache size: 87.3 MB
Number of HTTP files: 95
Wheels location: /root/.cache/pip/wheels
Wheels size: 0 bytes
Number of wheels: 0
tested on x86, does not work either...
root@t560:/home/christian/python_cryptography_build# ./build.sh 36.0.2
Cloning into 'cryptography'...
remote: Enumerating objects: 64537, done.
remote: Counting objects: 100% (1364/1364), done.
remote: Compressing objects: 100% (575/575), done.
remote: Total 64537 (delta 866), reused 1199 (delta 778), pack-reused 63173
Receiving objects: 100% (64537/64537), 50.36 MiB | 5.71 MiB/s, done.
Resolving deltas: 100% (44089/44089), done.
Note: checking out 'tags/36.0.2'.
You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by performing another checkout.
If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -b with the checkout command again. Example:
git checkout -b <new-branch-name>
HEAD is now at df06889f version bump and changelog (#6964)
Requirement already satisfied: pip in /usr/local/lib/python3.6/dist-packages (21.3.1)
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Obtaining file:///home/christian/python_cryptography_build/cryptography
Installing build dependencies ... done
Checking if build backend supports build_editable ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
Requirement already satisfied: cffi>=1.12 in /usr/local/lib/python3.6/dist-packages (from cryptography==36.0.2) (1.15.0)
Requirement already satisfied: pycparser in /usr/local/lib/python3.6/dist-packages (from cffi>=1.12->cryptography==36.0.2) (2.21)
Installing collected packages: cryptography
Running setup.py develop for cryptography
Successfully installed cryptography-36.0.2
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Obtaining file:///home/christian/python_cryptography_build/cryptography (from -r dev-requirements.txt (line 5))
Installing build dependencies ... done
Checking if build backend supports build_editable ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
Obtaining file:///home/christian/python_cryptography_build/cryptography/vectors (from -r dev-requirements.txt (line 6))
Preparing metadata (setup.py) ... done
Requirement already satisfied: click in /usr/local/lib/python3.6/dist-packages (from -r dev-requirements.txt (line 1)) (8.0.4)
Requirement already satisfied: coverage in /usr/local/lib/python3.6/dist-packages (from -r dev-requirements.txt (line 2)) (6.2)
Requirement already satisfied: tox>=2.4.1 in /usr/local/lib/python3.6/dist-packages (from -r dev-requirements.txt (line 3)) (3.24.5)
Requirement already satisfied: twine>=1.8.0 in /usr/local/lib/python3.6/dist-packages (from -r dev-requirements.txt (line 4)) (3.8.0)
Requirement already satisfied: importlib-metadata in /usr/local/lib/python3.6/dist-packages (from click->-r dev-requirements.txt (line 1)) (4.8.3)
Requirement already satisfied: virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 in /usr/local/lib/python3.6/dist-packages (from tox>=2.4.1->-r dev-requirements.txt (line 3)) (20.14.0)
Requirement already satisfied: six>=1.14.0 in /usr/local/lib/python3.6/dist-packages (from tox>=2.4.1->-r dev-requirements.txt (line 3)) (1.16.0)
Requirement already satisfied: pluggy>=0.12.0 in /usr/local/lib/python3.6/dist-packages (from tox>=2.4.1->-r dev-requirements.txt (line 3)) (1.0.0)
Requirement already satisfied: toml>=0.9.4 in /usr/local/lib/python3.6/dist-packages (from tox>=2.4.1->-r dev-requirements.txt (line 3)) (0.9.6)
Requirement already satisfied: filelock>=3.0.0 in /usr/local/lib/python3.6/dist-packages (from tox>=2.4.1->-r dev-requirements.txt (line 3)) (3.4.1)
Requirement already satisfied: packaging>=14 in /usr/local/lib/python3.6/dist-packages (from tox>=2.4.1->-r dev-requirements.txt (line 3)) (21.3)
Requirement already satisfied: py>=1.4.17 in /usr/local/lib/python3.6/dist-packages (from tox>=2.4.1->-r dev-requirements.txt (line 3)) (1.11.0)
Requirement already satisfied: tqdm>=4.14 in /usr/local/lib/python3.6/dist-packages (from twine>=1.8.0->-r dev-requirements.txt (line 4)) (4.64.0)
Requirement already satisfied: pkginfo>=1.8.1 in /usr/local/lib/python3.6/dist-packages (from twine>=1.8.0->-r dev-requirements.txt (line 4)) (1.8.2)
Requirement already satisfied: requests>=2.20 in /usr/local/lib/python3.6/dist-packages (from twine>=1.8.0->-r dev-requirements.txt (line 4)) (2.27.1)
Requirement already satisfied: urllib3>=1.26.0 in /usr/local/lib/python3.6/dist-packages (from twine>=1.8.0->-r dev-requirements.txt (line 4)) (1.26.9)
Requirement already satisfied: requests-toolbelt!=0.9.0,>=0.8.0 in /usr/lib/python3/dist-packages (from twine>=1.8.0->-r dev-requirements.txt (line 4)) (0.8.0)
Requirement already satisfied: colorama>=0.4.3 in /usr/local/lib/python3.6/dist-packages (from twine>=1.8.0->-r dev-requirements.txt (line 4)) (0.4.4)
Requirement already satisfied: keyring>=15.1 in /usr/local/lib/python3.6/dist-packages (from twine>=1.8.0->-r dev-requirements.txt (line 4)) (23.4.1)
Requirement already satisfied: rfc3986>=1.4.0 in /usr/local/lib/python3.6/dist-packages (from twine>=1.8.0->-r dev-requirements.txt (line 4)) (1.5.0)
Requirement already satisfied: readme-renderer>=21.0 in /usr/local/lib/python3.6/dist-packages (from twine>=1.8.0->-r dev-requirements.txt (line 4)) (34.0)
Requirement already satisfied: cffi>=1.12 in /usr/local/lib/python3.6/dist-packages (from cryptography==36.0.2->-r dev-requirements.txt (line 5)) (1.15.0)
Requirement already satisfied: flake8-import-order in /usr/local/lib/python3.6/dist-packages (from cryptography==36.0.2->-r dev-requirements.txt (line 5)) (0.18.1)
Requirement already satisfied: pep8-naming in /usr/local/lib/python3.6/dist-packages (from cryptography==36.0.2->-r dev-requirements.txt (line 5)) (0.12.1)
Requirement already satisfied: flake8 in /usr/local/lib/python3.6/dist-packages (from cryptography==36.0.2->-r dev-requirements.txt (line 5)) (3.9.2)
Requirement already satisfied: black in /usr/local/lib/python3.6/dist-packages (from cryptography==36.0.2->-r dev-requirements.txt (line 5)) (22.3.0)
Requirement already satisfied: pyenchant>=1.6.11 in /usr/local/lib/python3.6/dist-packages (from cryptography==36.0.2->-r dev-requirements.txt (line 5)) (3.2.2)
Requirement already satisfied: sphinxcontrib-spelling>=4.0.1 in /usr/local/lib/python3.6/dist-packages (from cryptography==36.0.2->-r dev-requirements.txt (line 5)) (7.3.2)
Requirement already satisfied: sphinx-rtd-theme in /usr/local/lib/python3.6/dist-packages (from cryptography==36.0.2->-r dev-requirements.txt (line 5)) (1.0.0)
Requirement already satisfied: sphinx!=1.8.0,!=3.1.0,!=3.1.1,>=1.6.5 in /usr/local/lib/python3.6/dist-packages (from cryptography==36.0.2->-r dev-requirements.txt (line 5)) (4.5.0)
Requirement already satisfied: pytest-subtests in /usr/local/lib/python3.6/dist-packages (from cryptography==36.0.2->-r dev-requirements.txt (line 5)) (0.7.0)
Requirement already satisfied: pytest-xdist in /usr/local/lib/python3.6/dist-packages (from cryptography==36.0.2->-r dev-requirements.txt (line 5)) (2.5.0)
Requirement already satisfied: pytz in /usr/lib/python3/dist-packages (from cryptography==36.0.2->-r dev-requirements.txt (line 5)) (2018.3)
Requirement already satisfied: pretend in /usr/local/lib/python3.6/dist-packages (from cryptography==36.0.2->-r dev-requirements.txt (line 5)) (1.0.9)
Requirement already satisfied: pytest-cov in /usr/local/lib/python3.6/dist-packages (from cryptography==36.0.2->-r dev-requirements.txt (line 5)) (3.0.0)
Requirement already satisfied: iso8601 in /usr/local/lib/python3.6/dist-packages (from cryptography==36.0.2->-r dev-requirements.txt (line 5)) (1.0.2)
Requirement already satisfied: hypothesis!=3.79.2,>=1.11.4 in /usr/local/lib/python3.6/dist-packages (from cryptography==36.0.2->-r dev-requirements.txt (line 5)) (6.31.6)
Requirement already satisfied: pytest>=6.2.0 in /usr/local/lib/python3.6/dist-packages (from cryptography==36.0.2->-r dev-requirements.txt (line 5)) (7.0.1)
Requirement already satisfied: pycparser in /usr/local/lib/python3.6/dist-packages (from cffi>=1.12->cryptography==36.0.2->-r dev-requirements.txt (line 5)) (2.21)
Requirement already satisfied: sortedcontainers<3.0.0,>=2.1.0 in /usr/local/lib/python3.6/dist-packages (from hypothesis!=3.79.2,>=1.11.4->cryptography==36.0.2->-r dev-requirements.txt (line 5)) (2.4.0)
Requirement already satisfied: attrs>=19.2.0 in /usr/local/lib/python3.6/dist-packages (from hypothesis!=3.79.2,>=1.11.4->cryptography==36.0.2->-r dev-requirements.txt (line 5)) (21.4.0)
Requirement already satisfied: typing-extensions>=3.6.4 in /usr/local/lib/python3.6/dist-packages (from importlib-metadata->click->-r dev-requirements.txt (line 1)) (4.1.1)
Requirement already satisfied: zipp>=0.5 in /usr/local/lib/python3.6/dist-packages (from importlib-metadata->click->-r dev-requirements.txt (line 1)) (3.6.0)
Requirement already satisfied: jeepney>=0.4.2 in /usr/local/lib/python3.6/dist-packages (from keyring>=15.1->twine>=1.8.0->-r dev-requirements.txt (line 4)) (0.7.1)
Requirement already satisfied: SecretStorage>=3.2 in /usr/local/lib/python3.6/dist-packages (from keyring>=15.1->twine>=1.8.0->-r dev-requirements.txt (line 4)) (3.3.1)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/lib/python3/dist-packages (from packaging>=14->tox>=2.4.1->-r dev-requirements.txt (line 3)) (2.2.0)
Requirement already satisfied: tomli>=1.0.0 in /usr/local/lib/python3.6/dist-packages (from pytest>=6.2.0->cryptography==36.0.2->-r dev-requirements.txt (line 5)) (1.2.3)
Requirement already satisfied: iniconfig in /usr/local/lib/python3.6/dist-packages (from pytest>=6.2.0->cryptography==36.0.2->-r dev-requirements.txt (line 5)) (1.1.1)
Requirement already satisfied: Pygments>=2.5.1 in /usr/local/lib/python3.6/dist-packages (from readme-renderer>=21.0->twine>=1.8.0->-r dev-requirements.txt (line 4)) (2.11.2)
Requirement already satisfied: bleach>=2.1.0 in /usr/local/lib/python3.6/dist-packages (from readme-renderer>=21.0->twine>=1.8.0->-r dev-requirements.txt (line 4)) (4.1.0)
Requirement already satisfied: docutils>=0.13.1 in /usr/local/lib/python3.6/dist-packages (from readme-renderer>=21.0->twine>=1.8.0->-r dev-requirements.txt (line 4)) (0.17.1)
Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3/dist-packages (from requests>=2.20->twine>=1.8.0->-r dev-requirements.txt (line 4)) (2.6)
Requirement already satisfied: charset-normalizer~=2.0.0 in /usr/local/lib/python3.6/dist-packages (from requests>=2.20->twine>=1.8.0->-r dev-requirements.txt (line 4)) (2.0.12)
Requirement already satisfied: certifi>=2017.4.17 in /usr/lib/python3/dist-packages (from requests>=2.20->twine>=1.8.0->-r dev-requirements.txt (line 4)) (2018.1.18)
Requirement already satisfied: Jinja2>=2.3 in /usr/lib/python3/dist-packages (from sphinx!=1.8.0,!=3.1.0,!=3.1.1,>=1.6.5->cryptography==36.0.2->-r dev-requirements.txt (line 5)) (2.10)
Requirement already satisfied: alabaster<0.8,>=0.7 in /usr/local/lib/python3.6/dist-packages (from sphinx!=1.8.0,!=3.1.0,!=3.1.1,>=1.6.5->cryptography==36.0.2->-r dev-requirements.txt (line 5)) (0.7.12)
Requirement already satisfied: babel>=1.3 in /usr/lib/python3/dist-packages (from sphinx!=1.8.0,!=3.1.0,!=3.1.1,>=1.6.5->cryptography==36.0.2->-r dev-requirements.txt (line 5)) (2.4.0)
Requirement already satisfied: sphinxcontrib-jsmath in /usr/local/lib/python3.6/dist-packages (from sphinx!=1.8.0,!=3.1.0,!=3.1.1,>=1.6.5->cryptography==36.0.2->-r dev-requirements.txt (line 5)) (1.0.1)
Requirement already satisfied: snowballstemmer>=1.1 in /usr/local/lib/python3.6/dist-packages (from sphinx!=1.8.0,!=3.1.0,!=3.1.1,>=1.6.5->cryptography==36.0.2->-r dev-requirements.txt (line 5)) (2.2.0)
Requirement already satisfied: sphinxcontrib-qthelp in /usr/local/lib/python3.6/dist-packages (from sphinx!=1.8.0,!=3.1.0,!=3.1.1,>=1.6.5->cryptography==36.0.2->-r dev-requirements.txt (line 5)) (1.0.3)
Requirement already satisfied: sphinxcontrib-serializinghtml>=1.1.5 in /usr/local/lib/python3.6/dist-packages (from sphinx!=1.8.0,!=3.1.0,!=3.1.1,>=1.6.5->cryptography==36.0.2->-r dev-requirements.txt (line 5)) (1.1.5)
Requirement already satisfied: sphinxcontrib-devhelp in /usr/local/lib/python3.6/dist-packages (from sphinx!=1.8.0,!=3.1.0,!=3.1.1,>=1.6.5->cryptography==36.0.2->-r dev-requirements.txt (line 5)) (1.0.2)
Requirement already satisfied: imagesize in /usr/local/lib/python3.6/dist-packages (from sphinx!=1.8.0,!=3.1.0,!=3.1.1,>=1.6.5->cryptography==36.0.2->-r dev-requirements.txt (line 5)) (1.3.0)
Requirement already satisfied: sphinxcontrib-applehelp in /usr/local/lib/python3.6/dist-packages (from sphinx!=1.8.0,!=3.1.0,!=3.1.1,>=1.6.5->cryptography==36.0.2->-r dev-requirements.txt (line 5)) (1.0.2)
Requirement already satisfied: sphinxcontrib-htmlhelp>=2.0.0 in /usr/local/lib/python3.6/dist-packages (from sphinx!=1.8.0,!=3.1.0,!=3.1.1,>=1.6.5->cryptography==36.0.2->-r dev-requirements.txt (line 5)) (2.0.0)
Requirement already satisfied: importlib-resources in /usr/local/lib/python3.6/dist-packages (from tqdm>=4.14->twine>=1.8.0->-r dev-requirements.txt (line 4)) (5.4.0)
Requirement already satisfied: platformdirs<3,>=2 in /usr/local/lib/python3.6/dist-packages (from virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0->tox>=2.4.1->-r dev-requirements.txt (line 3)) (2.4.0)
Requirement already satisfied: distlib<1,>=0.3.1 in /usr/local/lib/python3.6/dist-packages (from virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0->tox>=2.4.1->-r dev-requirements.txt (line 3)) (0.3.4)
Requirement already satisfied: mypy-extensions>=0.4.3 in /usr/local/lib/python3.6/dist-packages (from black->cryptography==36.0.2->-r dev-requirements.txt (line 5)) (0.4.3)
Requirement already satisfied: dataclasses>=0.6 in /usr/local/lib/python3.6/dist-packages (from black->cryptography==36.0.2->-r dev-requirements.txt (line 5)) (0.8)
Requirement already satisfied: typed-ast>=1.4.2 in /usr/local/lib/python3.6/dist-packages (from black->cryptography==36.0.2->-r dev-requirements.txt (line 5)) (1.5.2)
Requirement already satisfied: pathspec>=0.9.0 in /usr/local/lib/python3.6/dist-packages (from black->cryptography==36.0.2->-r dev-requirements.txt (line 5)) (0.9.0)
Requirement already satisfied: pyflakes<2.4.0,>=2.3.0 in /usr/local/lib/python3.6/dist-packages (from flake8->cryptography==36.0.2->-r dev-requirements.txt (line 5)) (2.3.1)
Requirement already satisfied: mccabe<0.7.0,>=0.6.0 in /usr/local/lib/python3.6/dist-packages (from flake8->cryptography==36.0.2->-r dev-requirements.txt (line 5)) (0.6.1)
Requirement already satisfied: pycodestyle<2.8.0,>=2.7.0 in /usr/local/lib/python3.6/dist-packages (from flake8->cryptography==36.0.2->-r dev-requirements.txt (line 5)) (2.7.0)
Requirement already satisfied: setuptools in /usr/lib/python3/dist-packages (from flake8-import-order->cryptography==36.0.2->-r dev-requirements.txt (line 5)) (39.0.1)
Requirement already satisfied: flake8-polyfill<2,>=1.0.2 in /usr/local/lib/python3.6/dist-packages (from pep8-naming->cryptography==36.0.2->-r dev-requirements.txt (line 5)) (1.0.2)
Requirement already satisfied: execnet>=1.1 in /usr/local/lib/python3.6/dist-packages (from pytest-xdist->cryptography==36.0.2->-r dev-requirements.txt (line 5)) (1.9.0)
Requirement already satisfied: pytest-forked in /usr/local/lib/python3.6/dist-packages (from pytest-xdist->cryptography==36.0.2->-r dev-requirements.txt (line 5)) (1.4.0)
Requirement already satisfied: webencodings in /usr/lib/python3/dist-packages (from bleach>=2.1.0->readme-renderer>=21.0->twine>=1.8.0->-r dev-requirements.txt (line 4)) (0.5)
Installing collected packages: cryptography, cryptography-vectors
Attempting uninstall: cryptography
Found existing installation: cryptography 36.0.2
Can't uninstall 'cryptography'. No files were found to uninstall.
Running setup.py develop for cryptography
Running setup.py develop for cryptography-vectors
Successfully installed cryptography-36.0.2 cryptography-vectors-36.0.2
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
=============================DEBUG ASSISTANCE==========================
If you are seeing an error here please try the following to
successfully install cryptography:
Upgrade to the latest pip and try again. This will fix errors for most
users. See: https://pip.pypa.io/en/stable/installing/#upgrading-pip
=============================DEBUG ASSISTANCE==========================
Traceback (most recent call last):
File "./setup.py", line 14, in <module>
from setuptools_rust import RustExtension
ModuleNotFoundError: No module named 'setuptools_rust'
=============================DEBUG ASSISTANCE==========================
If you are seeing an error here please try the following to
successfully install cryptography:
Upgrade to the latest pip and try again. This will fix errors for most
users. See: https://pip.pypa.io/en/stable/installing/#upgrading-pip
=============================DEBUG ASSISTANCE==========================
Traceback (most recent call last):
File "./setup.py", line 14, in <module>
from setuptools_rust import RustExtension
ModuleNotFoundError: No module named 'setuptools_rust'
problem with your script:
python3 -m venv cryptography-venv
pip3 install --upgrade pip
pip3 install --editable .
pip3 install --requirement dev-requirements.txt
python3 ./setup.py build
python3 ./setup.py bdist_wheel
You create the venv, but never active it, so the pip3
invocations are all using your global pip, not the venv one.
already fixed the script, the build error remains....
There are multiple build errors here, _cffi_backend
and setuptools_rust
. For the latter there is something wrong/outdated in your environment that's causing pip not to properly process the install dependency from pyproject.toml
on setuptools-rust. This can be manually worked around by simply installing it directly (pip install setuptools-rust
in the venv). For the cffi error despite it appearing installed in the environment the native module is missing, which means it did not successfully install. You'll need to figure that issue out.
the setuptools-rust problem is fixed by forcing installation in the venv...
concerning the cffi native thing...its already in the venv too.
(cryptography-venv) root@lpgaixmgmtlx01:/scratch/sink/python_crypography_build/cryptography/cryptography-venv>find . -name _cffi_backend.cpython-36m-powerpc64le-linux-gnu.so
./lib/python3.6/site-packages/_cffi_backend.cpython-36m-powerpc64le-linux-gnu.so
(cryptography-venv) root@lpgaixmgmtlx01:/scratch/sink/python_crypography_build/cryptography/cryptography-venv>ldd ./lib/python3.6/site-packages/_cffi_backend.cpython-36m-powerpc64le-linux-gnu.so
linux-vdso64.so.1 => (0x00003fff795a0000)
libffi-2b37fad8.so.8.1.0 => /scratch/sink/python_crypography_build/cryptography/cryptography-venv/./lib/python3.6/site-packages/cffi.libs/libffi-2b37fad8.so.8.1.0 (0x00003fff794e0000)
libpthread.so.0 => /lib64/libpthread.so.0 (0x00003fff79480000)
libc.so.6 => /lib64/libc.so.6 (0x00003fff79290000)
/lib64/ld64.so.2 (0x00003fff795c0000)
Does it work with other cffi projects like bcrypt or argon2-cffi? The import failure shown in the error suggests that a temporary installation pip is doing in a pep517 environment is failing…
ahhh, good point....does not work with bcrypt and others, something is really borked with that cffi stuff. no idea how to proceed from here...
Are you able to provide a dockerfile or similar reproducer from a clean image that demonstrates the issue? Right now none of us know how to reproduce this issue.
this is on a fat physical machine, i dont dont think its possible to provide a container file. seems to be a somewhat isolated problem anyway, so i will close this....
as no ppc64le binary is availabe (yeah, who cares about this "esoteric" platform), i was forced to build it myself, alas it fails.
error:
point is, i have python 3.6.12 and switching to 3.7 is not possible. so how to get this going?