Python requirements update

[kbrock]

Overview

Our current python packages are not compatible with the current ansible version installed (and/or the current python version).

CP4AIOPS-5619 / https://github.com/ManageIQ/manageiq-rpm_build/pull/495 was just focused on vmware and aws.

This provides all requirements.

Issues

In a container, not able to build gssapi (for pyspnego[kerberos], for ms/AD) This downloads many versions of gssapi but keeps failing. This may be because I'm doing this inside docker instead of at install time.

Reference

Dependencies brought up to date for:

• amazon/aws
• ansible/netcommon
• ansible/utils
• awx/awx
• azure/azcollection
• cisco/aci
• cisco/asa
• cisco/dnac
• cisco/intersight
• cisco/ios
• cisco/iosxr
• cisco/ise
• cisco/mso
• cisco/nxos
• cisco/ucs
• community/aws
• community/okd
• community/vmware
• google/cloud
• kubernetes/core
• microsoft/ad
• openstack/cloud
• ovirt/ovirt
• theforeman/foreman
• vmware/vmware_rest

[Fryguy]

This PR is fantastic - thanks for figuring this all out

[Fryguy]

@kbrock Recapping our private convo with @agrare , let's drop all of the ciscos from this list except for cisco/intersight.

[Fryguy]

This downloads many versions of gssapi but keeps failing.

What is the error you're getting? We might need to install a system package

[kbrock]

@Fryguy It looks like we are missing krb5-devel, but we install that. here

pip install 'pyspnego[kerberos]>=0.8.0'
Requirement already satisfied: pyspnego>=0.8.0 in /var/lib/manageiq/venv/lib/python3.9/site-packages (from pyspnego[kerberos]>=0.8.0) (0.11.1)
Requirement already satisfied: cryptography in /var/lib/manageiq/venv/lib64/python3.9/site-packages (from pyspnego>=0.8.0->pyspnego[kerberos]>=0.8.0) (43.0.1)
Collecting gssapi>=1.6.0 (from pyspnego[kerberos]>=0.8.0)
  Using cached gssapi-1.8.3.tar.gz (94 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... error
  error: subprocess-exited-with-error

  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [21 lines of output]
      /bin/sh: line 1: krb5-config: command not found

And truthfully, we should probably provide a minimum version on that library. I removed the minimum version hoping that the OS version would suffice.

[Fryguy]

I have a handful of Ruby comments but they can all be follow ups if needed.

[kbrock]

update:

• Added venv information for setup
• Fixed new_requirements name typo
• Fixed add_target to better support directories and missing files
• Better "legacy" requirements detection
• Using IO.foreach (File.foreach didn't work)
• Capitalization for comments
• Smaller python_version line detection
• ;python_version detection moved to ver processing (some day would be nice to improve)
• Fixed version 5+ regex
• pulled out split_lib_ver. Wasn't able to fix regexp - punting for now

[kbrock]

ok, so with our list of requirements, we only have 1 or 2 version comparisons to make.

I think having a very rudimentary system and displaying the work so a person can double check the work makes the most sense.

[Fryguy]

@kbrock This closed a lot of Mend issues 🎉 , but seems to have opened a few more. See https://github.com/ManageIQ/manageiq-rpm_build/issues?q=is%3Aissue+sort%3Aupdated-desc+updated%3A2024-09-18T02%3A50%3A00-04%3A00..2024-09-19+author%3Aapp%2Fmend-bolt-for-github