clustervision / trinityX

TrinityX is the new generation of ClusterVision's open-source HPC, A/I and cloudbursting platform. It is designed from the ground up to provide all services required in a modern HPC and A/I system, and to allow full customization of the installation.
GNU General Public License v3.0
67 stars 37 forks source link

Missing python package breaks luna2 installation #397

Closed xdkreij closed 7 months ago

xdkreij commented 11 months ago

Task Error

TASK [trinity/luna2 : Install luna2 daemon] *************************************************************************************************************************************
fatal: [d-vcpu-srv-01]: FAILED! => {"changed": true, "cmd": "source /trinity/local/python/bin/activate\npip3 install --upgrade https://updates.clustervision.com/trinityx/14/luna2/noarch/pip/stable/daemon/luna2-daemon-2.0.latest-py3-none-any.whl\nexit $?\n", "delta": "0:00:19.413176", "end": "2023-12-19 14:41:16.382093", "msg": "non-zero return code", "rc": 1, "start": "2023-12-19 14:40:56.968917", "stderr": "ERROR: Could not find a version that satisfies the requirement PyJWT==2.8.0 (from luna2) (from versions: 0.1.1, 0.1.2, 0.1.3, 0.1.4, 0.1.5, 0.1.6, 0.1.7, 0.1.8, 0.1.9, 0.2.0, 0.2.1, 0.2.3, 0.3.0, 0.3.1, 0.3.2, 0.4.0, 0.4.1, 0.4.2, 0.4.3, 1.0.0, 1.0.1, 1.1.0, 1.3.0, 1.4.0, 1.4.1, 1.4.2, 1.5.0, 1.5.1, 1.5.2, 1.5.3, 1.6.0, 1.6.1, 1.6.3, 1.6.4, 1.7.0, 1.7.1, 2.0.0a1, 2.0.0a2, 2.0.0, 2.0.1, 2.1.0, 2.2.0, 2.3.0, 2.4.0)\nERROR: No matching distribution found for PyJWT==2.8.0\nWARNING: You are using pip version 21.3.1; however, version 23.3.2 is available.\nYou should consider upgrading via the '/trinity/local/python/bin/platform-python -m pip install --upgrade pip' command.",

Highlighting the error

"ERROR: Could not find a version that satisfies the requirement PyJWT==2.8.0 (from luna2) (from versions: 0.1.1, 0.1.2, 0.1.3, 0.1.4, 0.1.5, 0.1.6, 0.1.7, 0.1.8, 0.1.9, 0.2.0, 0.2.1, 0.2.3, 0.3.0, 0.3.1, 0.3.2, 0.4.0, 0.4.1, 0.4.2, 0.4.3, 1.0.0, 1.0.1, 1.1.0, 1.3.0, 1.4.0, 1.4.1, 1.4.2, 1.5.0, 1.5.1, 1.5.2, 1.5.3, 1.6.0, 1.6.1, 1.6.3, 1.6.4, 1.7.0, 1.7.1, 2.0.0a1, 2.0.0a2, 2.0.0, 2.0.1, 2.1.0, 2.2.0, 2.3.0, 2.4.0

Expected results

edit: seems that this specific package requires python3.7 or higher; Ansible doesn't verify this requirement as a prerequisite

xdkreij commented 11 months ago

image

Seems python3.6 is hardcoded.... this surely causes the PyJWT package version 2.8.0 to not be installed as python 3.7 or higher is required. Is the PyJWT version 2.8.0 a hard requirement, or does 2.4.0 for python3.6 suffice?

xdkreij commented 10 months ago

Same goes for other python packages

TASK [trinity/luna2 : Install luna2 daemon] ***********************************************************************************************************************************
{
   "changed":true,
   "cmd":"source /trinity/local/python/bin/activate\npip3 install --upgrade https://updates.clustervision.com/trinityx/14/luna2/noarch/pip/stable/daemon/luna2-daemon-2.0.latest-py3-none-any.whl\nexit $?\n",
   "delta":"0:00:16.370595",
   "end":"2024-01-04 15:22:51.539289",
   "msg":"non-zero return code",
   "rc":1,
   "start":"2024-01-04 15:22:35.168694",
   "stderr":"ERROR: Could not find a version that satisfies the requirement cryptography==41.0.3 (from luna2) (from versions: 0.1, 0.2, 0.2.1, 0.2.2, 0.3, 0.4, 0.5, 0.5.1, 0.5.2, 0.5.3, 0.5.4, 0.6, 0.6.1, 0.7, 0.7.1, 0.7.2, 0.8, 0.8.1, 0.8.2, 0.9, 0.9.1, 0.9.2, 0.9.3, 1.0, 1.0.1, 1.0.2, 1.1, 1.1.1, 1.1.2, 1.2, 1.2.1, 1.2.2, 1.2.3, 1.3, 1.3.1, 1.3.2, 1.3.3, 1.3.4, 1.4, 1.5, 1.5.1, 1.5.2, 1.5.3, 1.6, 1.7, 1.7.1, 1.7.2, 1.8, 1.8.1, 1.8.2, 1.9, 2.0, 2.0.1, 2.0.2, 2.0.3, 2.1, 2.1.1, 2.1.2, 2.1.3, 2.1.4, 2.2, 2.2.1, 2.2.2, 2.3, 2.3.1, 2.4, 2.4.1, 2.4.2, 2.5, 2.6, 2.6.1, 2.7, 2.8, 2.9, 2.9.1, 2.9.2, 3.0, 3.1, 3.1.1, 3.2, 3.2.1, 3.3, 3.3.1, 3.3.2, 3.4, 3.4.1, 3.4.2, 3.4.3, 3.4.4, 3.4.5, 3.4.6, 3.4.7, 3.4.8, 35.0.0, 36.0.0, 36.0.1, 36.0.2, 37.0.0, 37.0.1, 37.0.2, 37.0.3, 37.0.4, 38.0.0, 38.0.1, 38.0.2, 38.0.3, 38.0.4, 39.0.0, 39.0.1, 39.0.2, 40.0.0, 40.0.1, 40.0.2)\nERROR: No matching distribution found for cryptography==41.0.3",
   "stderr_lines":[
      "ERROR: Could not find a version that satisfies the requirement cryptography==41.0.3 (from luna2) (from versions: 0.1, 0.2, 0.2.1, 0.2.2, 0.3, 0.4, 0.5, 0.5.1, 0.5.2, 0.5.3, 0.5.4, 0.6, 0.6.1, 0.7, 0.7.1, 0.7.2, 0.8, 0.8.1, 0.8.2, 0.9, 0.9.1, 0.9.2, 0.9.3, 1.0, 1.0.1, 1.0.2, 1.1, 1.1.1, 1.1.2, 1.2, 1.2.1, 1.2.2, 1.2.3, 1.3, 1.3.1, 1.3.2, 1.3.3, 1.3.4, 1.4, 1.5, 1.5.1, 1.5.2, 1.5.3, 1.6, 1.7, 1.7.1, 1.7.2, 1.8, 1.8.1, 1.8.2, 1.9, 2.0, 2.0.1, 2.0.2, 2.0.3, 2.1, 2.1.1, 2.1.2, 2.1.3, 2.1.4, 2.2, 2.2.1, 2.2.2, 2.3, 2.3.1, 2.4, 2.4.1, 2.4.2, 2.5, 2.6, 2.6.1, 2.7, 2.8, 2.9, 2.9.1, 2.9.2, 3.0, 3.1, 3.1.1, 3.2, 3.2.1, 3.3, 3.3.1, 3.3.2, 3.4, 3.4.1, 3.4.2, 3.4.3, 3.4.4, 3.4.5, 3.4.6, 3.4.7, 3.4.8, 35.0.0, 36.0.0, 36.0.1, 36.0.2, 37.0.0, 37.0.1, 37.0.2, 37.0.3, 37.0.4, 38.0.0, 38.0.1, 38.0.2, 38.0.3, 38.0.4, 39.0.0, 39.0.1, 39.0.2, 40.0.0, 40.0.1, 40.0.2)",
      "ERROR: No matching distribution found for cryptography==41.0.3"
   ],
   "stdout":"Collecting luna2==daemon\n  Using cached https://updates.clustervision.com/trinityx/14/luna2/noarch/pip/stable/daemon/luna2-daemon-2.0.latest-py3-none-any.whl (249 kB)\nCollecting netaddr==0.8.0\n  Downloading netaddr-0.8.0-py2.py3-none-any.whl (1.9 MB)\nCollecting gunicorn==21.2.0\n  Using cached gunicorn-21.2.0-py3-none-any.whl (80 kB)",
   "stdout_lines":[
      "Collecting luna2==daemon",
      "  Using cached https://updates.clustervision.com/trinityx/14/luna2/noarch/pip/stable/daemon/luna2-daemon-2.0.latest-py3-none-any.whl (249 kB)",
      "Collecting netaddr==0.8.0",
      "  Downloading netaddr-0.8.0-py2.py3-none-any.whl (1.9 MB)",
      "Collecting gunicorn==21.2.0",
      "  Using cached gunicorn-21.2.0-py3-none-any.whl (80 kB)"
   ]
}
xdkreij commented 10 months ago

Removing python3.6 venv and installing python3.9 venv

rm -rf /trinity/local/python && python3.9 -m venv python

re-run the play

sudo /usr/local/bin/ansible-playbook controller.yml --tags=luna

und disco!

PLAY RECAP ********************************************************************************************************************************************************************
d-vcpu-srv-01              : ok=67   changed=29   unreachable=0    failed=1    skipped=14   rescued=0    ignored=0
[ansible@d-vcpu-srv-01 site]$ source /trinity/local/python/bin/activate
(python) [ansible@d-vcpu-srv-01 site]$ pip list
Package             Version
------------------- --------------
annotated-types     0.6.0
blinker             1.7.0
certifi             2023.11.17
cffi                1.16.0
charset-normalizer  3.3.2
click               8.1.7
configparser        5.3.0
cryptography        41.0.3
et-xmlfile          1.1.0
fire                0.5.0
flask               2.3.3
gunicorn            21.2.0
idna                3.6
importlib-metadata  7.0.1
itsdangerous        2.1.2
Jinja2              3.1.2
libtorrent          2.0.9
luna2-cli           2.0.1703856948
luna2-daemon        2.0.1703857854
luna2-utils         2.0.1703700840
MarkupSafe          2.1.3
nested-lookup       0.2.25
netaddr             0.8.0
netifaces           0.11.0
openpyxl            3.1.2
packaging           23.2
pip                 20.2.4
prettytable         3.8.0
pycparser           2.21
pydantic            2.5.3
pydantic-core       2.14.6
pyfiglet            0.8.post1
PyJWT               2.8.0
pyodbc              4.0.39
python-hostlist     1.23.0
requests            2.29.0
requests-unixsocket 0.3.0
setuptools          50.3.2
six                 1.16.0
snmp                0.5.0
termcolor           2.3.0
typing-extensions   4.9.0
urllib3             1.26.16
wcwidth             0.2.12
werkzeug            3.0.1
zipp                3.17.0
aphmschonewille commented 7 months ago

This problem has been resolved in current release.