search

uqfoundation / pathos

parallel graph management and execution in heterogeneous computing
http://pathos.rtfd.io
Other
1.38k stars 89 forks source link

Installation never completes on Python 3.8 #167

Closed oliwarner closed 4 years ago

oliwarner commented 5 years ago

Setup fails from pip with the setup.py just hanging at 100% CPU. If I attach strace, I see it looping hard on a missing file.

    Found link https://files.pythonhosted.org/packages/31/60/6d74caa02b54ca43092e745640c7d98f367f07160441682a01602ce00bc5/multiprocess-0.70.7.tar.gz#sha256=46479a327388df8e77ad268892f2e73eac06d6271189b868ce9d4f95474e58e3 (from https://pypi.org/simple/multiprocess/), version: 0.70.7
  Using version 0.70.7 (newest of versions: 0.70.1, 0.70.3, 0.70.4, 0.70.5, 0.70.6, 0.70.6.1, 0.70.7)
  Created temporary directory: /tmp/pip-unpack-7u6alh85
  Looking up "https://files.pythonhosted.org/packages/31/60/6d74caa02b54ca43092e745640c7d98f367f07160441682a01602ce00bc5/multiprocess-0.70.7.tar.gz" in the cache
  Current age based on date: 4616890
  Ignoring unknown cache-control directive: immutable
  Freshness lifetime from max-age: 365000000
  The response is "fresh", returning cached response
  365000000 > 4616890
  Using cached https://files.pythonhosted.org/packages/31/60/6d74caa02b54ca43092e745640c7d98f367f07160441682a01602ce00bc5/multiprocess-0.70.7.tar.gz
  Downloading from URL https://files.pythonhosted.org/packages/31/60/6d74caa02b54ca43092e745640c7d98f367f07160441682a01602ce00bc5/multiprocess-0.70.7.tar.gz#sha256=46479a327388df8e77ad268892f2e73eac06d6271189b868ce9d4f95474e58e3 (from https://pypi.org/simple/multiprocess/)
  Added multiprocess from https://files.pythonhosted.org/packages/31/60/6d74caa02b54ca43092e745640c7d98f367f07160441682a01602ce00bc5/multiprocess-0.70.7.tar.gz#sha256=46479a327388df8e77ad268892f2e73eac06d6271189b868ce9d4f95474e58e3 to build tracker '/tmp/pip-req-tracker-4vhnzo_6'
    Running setup.py (path:/tmp/pip-install-2ja676bz/multiprocess/setup.py) egg_info for package multiprocess
    Running command python setup.py egg_info

That's where it hangs...

stat("/tmp/pip-install-2ja676bz/multiprocess/py-4615515.101188219", 0x7fffeed2e9f0) = -1 ENOENT (No such file or directory)
stat("/tmp/pip-install-2ja676bz/multiprocess/py-4615515.201188219", 0x7fffeed2e9f0) = -1 ENOENT (No such file or directory)
stat("/tmp/pip-install-2ja676bz/multiprocess/py-4615515.301188218", 0x7fffeed2e9f0) = -1 ENOENT (No such file or directory)
stat("/tmp/pip-install-2ja676bz/multiprocess/py-4615515.401188218", 0x7fffeed2e9f0) = -1 ENOENT (No such file or directory)
stat("/tmp/pip-install-2ja676bz/multiprocess/py-4615515.501188218", 0x7fffeed2e9f0) = -1 ENOENT (No such file or directory)
stat("/tmp/pip-install-2ja676bz/multiprocess/py-4615515.601188217", 0x7fffeed2e9f0) = -1 ENOENT (No such file or directory)
stat("/tmp/pip-install-2ja676bz/multiprocess/py-4615515.701188217", 0x7fffeed2e9f0) = -1 ENOENT (No such file or directory)
stat("/tmp/pip-install-2ja676bz/multiprocess/py-4615515.801188217", 0x7fffeed2e9f0) = -1 ENOENT (No such file or directory)
mmckerns commented 5 years ago

@oliwarner: pathos doesn't yet work with python 3.8-- as there's no support for 3.8 from multiprocess. The reason is that I haven't yet forked multiprocessing from the python 3.8 alpha releases. This (a release of a fork of multiprocessing) will be done before the initial python 3.8 release (typically, between beta1 and rc1).

mmckerns commented 5 years ago

I've just added multiprocess support for python3.8. So, in theory pathos should work for python3.8b1. There may still be some kinks in the installation process that need to be worked out for 3.8 due to multiprocess... but pathos does now support 3.8. Needs testing and some work. More to come...

mmckerns commented 4 years ago

Should be fine now. Closing. Reopen if it's not working for you.