conda-forge / cupy-feedstock

A conda-smithy repository for cupy.
BSD 3-Clause "New" or "Revised" License
5 stars 23 forks source link

Build CuPy for PowerPC? #14

Closed leofang closed 2 years ago

leofang commented 4 years ago

Continuing the discussion in https://github.com/cupy/cupy/issues/2583#issuecomment-553603461.

@jakirkham @isuruf Do we have the compiler/docker/CI infrastructure for this task? A while ago I verified on Ascent (Summit's test node) that CuPy works on PowerPC, so it's just a matter of preparing and building.

cc: @berceanu

leofang commented 4 years ago

It seems we need conda-forge/nvcc-feedstock#21 to be closed first.

leofang commented 4 years ago

cf: AnacondaRecipes/cudatoolkit-feedstock#4

leofang commented 4 years ago

Pending https://github.com/AnacondaRecipes/cudatoolkit-feedstock/pull/6 and https://github.com/conda-forge/docker-images/issues/141.

jakirkham commented 4 years ago

The nvcc bit is easy once we have cudatoolkit.

leofang commented 4 years ago

AnacondaRecipes/cudatoolkit-feedstock#6 is merged!

jakirkham commented 4 years ago

Now we just need to figure out how to get the older versions in there 🙂

https://github.com/AnacondaRecipes/cudatoolkit-feedstock/issues/8

leofang commented 3 years ago

Can we build on top of CF's Power8 cudatoolkit instead? https://github.com/conda-forge/cudatoolkit-feedstock/pull/6

jakirkham commented 3 years ago

Right now we are still building out cudatoolkit versions. There's also some integration work needed. That said, yeah I think that should be possible.

leofang commented 3 years ago

@jakirkham How close we are to build for ppcle64? I lost track...

leofang commented 3 years ago

Looks like updating pinning is the last missing piece? https://github.com/conda-forge/conda-forge-pinning-feedstock/issues/725

jakirkham commented 3 years ago

Maybe @jaimergp would know 😉

jaimergp commented 3 years ago

Hi! Yes, it's been on my list for a while, but it got deprioritized after finding out OpenMM has some issues on GCC9+PPC, so I focused on other things while those are solved.

I can work on it after I am done with https://github.com/conda-forge/nvcc-feedstock/pull/59.

IIRC, we need:

leofang commented 3 years ago

Note to self: cuSPARSELt currently does not support ppc64le.

leofang commented 3 years ago

Support for ppc64le + CUDA 10.2 is done for v9.2.0 (#134) and v10.0.0a2 (#135). Thank you @jaimergp again for making the infrastructure available!

leofang commented 2 years ago

Hi all, I am reopening this issue for discussion. I've been monitoring CuPy's download counts regularly, and I noticed the download counts have been consistently on the order of 15 for every version (Python x CUDA) on ppc64le, making me suspect we have almost no human user of the ppc64le packages. If it's the case, we should consider to not build them so as to save CI and anaconda.org resources.

leofang commented 2 years ago

Let me start by shrinking the build matrix for ppc64le.