ERROR: No matching distribution found for setuptools>=61.0.0 when trying to install pspamm on supermuc

[Thomas-Ulrich]

di73yeq4@login02:/hppfs/work/pn49ha/di73yeq4/seissol-spack-aid/spack/packages> module list
Currently Loaded Modulefiles:
 1) admin/1.0     3) lrz/1.0        5) intel-oneapi-compilers/2021.4.0(default:intel)   7) intel-mpi/2019-intel   9) cmake/3.21.4            11) user_spack/23.1.0       
 2) tempdir/1.0   4) spack/22.2.1   6) intel-mkl/2020                                   8) gcc/11.2.0            10) numactl/2.0.14-intel21  12) python/3.8.11-extended  

Key:
(symbolic-version)  default-version  sticky

di73yeq4@login02:/hppfs/work/pn49ha/di73yeq4/seissol-spack-aid/spack/packages> pip install --upgrade setuptools --user --proxy http://localhost:24382/
Requirement already satisfied: setuptools in /dss/lrzsys/sys/spack/release/22.2.1/views/python/._3.8.11-extended/o7ub5bgyat4qjtrqusu363fom6gg6hmv/lib/python3.8/site-packages (57.4.0)
Collecting setuptools
  Downloading setuptools-69.2.0-py3-none-any.whl.metadata (6.3 kB)
Downloading setuptools-69.2.0-py3-none-any.whl (821 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 821.5/821.5 kB 6.3 MB/s eta 0:00:00
Installing collected packages: setuptools
Successfully installed setuptools-69.2.0
2024-03-22 14:46:42,743 - pid:459704 [I] server.access_log:384 - 127.0.0.1:45664 - CONNECT files.pythonhosted.org:443 - 835185 bytes - 1514.00ms
                                                                                                                                                2024-03-22 14:46:42,744 - pid:459715 [I] server.access_log:384 - 127.0.0.1:45652 - CONNECT pypi.org:443 - 177362 bytes - 1903.68ms
                                                                 di73yeq4@login02:/hppfs/work/pn49ha/di73yeq4/seissol-spack-aid/spack/packages> pip install --upgrade setuptools --user --proxy http://localhost:git+https://github.com/SeisSol/PSpaMM.git                                      
di73yeq4@login02:/hppfs/work/pn49ha/di73yeq4/seissol-spack-aid/spack/packages> pip install git+https://github.com/SeisSol/PSpaMM.git --user --proxy http://localhost:24382/
Collecting git+https://github.com/SeisSol/PSpaMM.git
  Cloning https://github.com/SeisSol/PSpaMM.git to /hppfs/scratch/0A/di73yeq4/tmp/pip-req-build-gg_ja47x
  Running command git clone --filter=blob:none --quiet https://github.com/SeisSol/PSpaMM.git /hppfs/scratch/0A/di73yeq4/tmp/pip-req-build-gg_ja47x
  @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
  @    WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED!     @
  @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
  IT IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY!
  Someone could be eavesdropping on you right now (man-in-the-middle attack)!
  It is also possible that a host key has just been changed.
  The fingerprint for the RSA key sent by the remote host is
  SHA256:uNiVztksCsDhcc0u9e8BujQXVUpKZIDTMczCvj3tD2s.
  Please contact your system administrator.
  Add correct host key in /dss/dsshome1/0A/di73yeq4/.ssh/known_hosts to get rid of this message.
  Offending RSA key in /dss/dsshome1/0A/di73yeq4/.ssh/known_hosts:4
  You can use following command to remove the offending key:
  ssh-keygen -R [localhost]:24380 -f /dss/dsshome1/0A/di73yeq4/.ssh/known_hosts
  Password authentication is disabled to avoid man-in-the-middle attacks.
  Keyboard-interactive authentication is disabled to avoid man-in-the-middle attacks.
Enter passphrase for key '/dss/dsshome1/0A/di73yeq4/.ssh/id_rsa': 
  @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
  @    WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED!     @
  @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
  IT IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY!
  Someone could be eavesdropping on you right now (man-in-the-middle attack)!
  It is also possible that a host key has just been changed.
  The fingerprint for the RSA key sent by the remote host is
  SHA256:uNiVztksCsDhcc0u9e8BujQXVUpKZIDTMczCvj3tD2s.
  Please contact your system administrator.
  Add correct host key in /dss/dsshome1/0A/di73yeq4/.ssh/known_hosts to get rid of this message.
  Offending RSA key in /dss/dsshome1/0A/di73yeq4/.ssh/known_hosts:4
  You can use following command to remove the offending key:
  ssh-keygen -R [localhost]:24380 -f /dss/dsshome1/0A/di73yeq4/.ssh/known_hosts
  Password authentication is disabled to avoid man-in-the-middle attacks.
  Keyboard-interactive authentication is disabled to avoid man-in-the-middle attacks.
Enter passphrase for key '/dss/dsshome1/0A/di73yeq4/.ssh/id_rsa': 
  Resolved https://github.com/SeisSol/PSpaMM.git to commit 0f56877a0968e0aada63fcf80730cec8faa13fbc
  Installing build dependencies ... error
  error: subprocess-exited-with-error

  × pip subprocess to install build dependencies did not run successfully.
  │ exit code: 1
  ╰─> [7 lines of output]
      WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f4f172cf0a0>: Failed to establish a new connection: [Errno 101] Network is unreachable')': /simple/setuptools/
      WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f4f1730bf10>: Failed to establish a new connection: [Errno 101] Network is unreachable')': /simple/setuptools/
      WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f4f173332e0>: Failed to establish a new connection: [Errno 101] Network is unreachable')': /simple/setuptools/
      WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f4f172cf3a0>: Failed to establish a new connection: [Errno 101] Network is unreachable')': /simple/setuptools/
      WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f4f172cf550>: Failed to establish a new connection: [Errno 101] Network is unreachable')': /simple/setuptools/
      ERROR: Could not find a version that satisfies the requirement setuptools>=61.0.0 (from versions: none)
      ERROR: No matching distribution found for setuptools>=61.0.0
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.

[davschneller]

Does it work with --no-build-isolation for pip? (cf. https://pip.pypa.io/en/stable/cli/pip_download/#cmdoption-no-build-isolation )

[Thomas-Ulrich]

yes!

[Thomas-Ulrich]

should we update https://seissol.readthedocs.io/en/latest/installing-dependencies.html#installing-pspamm?

[davschneller]

I'd guess it's mostly useful in environments such as SuperMUC-NG Phase 1/2 (e.g. it works perfectly fine w/o that flag already on Leonardo)—so maybe add a comment that this option can help in case of an error? (and/or an entry to the troubleshooting section?)

[Thomas-Ulrich]

@davschneller I think the problem is that requires = ["setuptools>=61.0.0", "wheel"] only gives requirements but pip does not interpret it as it has to install these additional packages if it does not have them. I mean somebody else got the same problem today (setuptools>=61.0.0 and bdist_wheel unkwown) and it was fixed by manually installing the packages.