Apparently the pip install takes forever if you pass all the wheels at once. Which is not to say that it will be fast if you invoke pip install once for each wheel, but worth a try.
My antivirus is also flaring up when pip runs, so that may or may not be confounding things.
EDIT: In addition to parallelizing the pip install, we could see if there's a better way to store our wheels (e.g., don't store wheels directly in the cache, but rather unpack them? Perhaps also immitate a pip install except instead of copying files around, we just symlink to the unpacked wheels in the cache?)
Apparently the
pip installtakes forever if you pass all the wheels at once. Which is not to say that it will be fast if you invokepip installonce for each wheel, but worth a try.UPDATE:
parallelism = 1: 75s parallelism = 2: 40s parallelism = 4: 35s parallelism = 8: 40s parallelism = len(wheels): 50s
My antivirus is also flaring up when pip runs, so that may or may not be confounding things.
EDIT: In addition to parallelizing the pip install, we could see if there's a better way to store our wheels (e.g., don't store wheels directly in the cache, but rather unpack them? Perhaps also immitate a pip install except instead of copying files around, we just symlink to the unpacked wheels in the cache?)