open-ce / pytorch-feedstock

Apache License 2.0
5 stars 11 forks source link

Incompatible package errors from torch 2.1.2 feedstock build #120

Open bbartoldson opened 8 months ago

bbartoldson commented 8 months ago

I noticed the following error. I am happy to help resolve it if you can suggest something to try next. Thank you! -Brian

Error: Using the newly merged PyTorch 2.1.2 framework creates the incompatible package errors shown in the following image.

Screenshot 2024-01-08 at 5 49 35 PM

Details: This happened on a Power9 computer when following the instructions for building a single feedstock.

madmax-codewarrior-0 commented 8 months ago

@bbartoldson Specifically regarding this issue, openblas-devel v0.3.24. likely isn't available, unless you attempted to build and install it (usually to the conda environment), or you installed it from another channel. protobuf also wouldn't be installed if python 3.11. were to also be installed (it's outside the version requirements).

It looks like @cdeepali just merged this version, and I am attempting to build it currently with an env based on python 3.9.18. After/if it completes, I'll install it to the temp environment and attempt to build pytorch 2.1.2.

I was forwarded your email regarding the timing on this package being built at CQLS + OSL. If you wish, we can discuss it further on the Open-CE Slack.

cdeepali commented 8 months ago

Yes, we have recently merged changes for PyTorch 2.1.2, however it is still being tested at our end. We have added openblas v0.3.24 today morning, so this should proceed now.

PS: We are still in dev/testing phase for the OpenCE v1.11 which will provide PyTorch v2.1.2.

bbartoldson commented 8 months ago

Based on the above comments, I am trying to build the torch feedstock by first building the updated openblas feedstock, but building the openblas feedstock leads to the following package-does-not-exist error.

Screenshot 2024-01-09 at 10 58 48 AM

When trying to build openblas, the command I used from inside the openblas feedstock repository was: open-ce build feedstock --conda_build_config ../open-ce/envs/conda_build_config.yaml

Since you are still in the dev/testing phase, I can close this issue unless you think it should remain open. Either way, please let me know if I can help test anything.

cdeepali commented 8 months ago

PyTorch has a number of dependencies which are included in the pytorch-env.yaml. I would recommend that you use the open-ce build env command for your builds. https://github.com/open-ce/open-ce-builder/blob/main/doc/README.open_ce_build.md#open-ce-build-env-sub-command

jesulo commented 7 months ago

Hi, I have same issue.

Could not solve for environment specs The following packages are incompatible ├─ numactl 2.0.* does not exist (perhaps a typo or a missing channel); ├─ openblas-devel 0.3.26.* does not exist (perhaps a typo or a missing channel); └─ protobuf 4.21.12.* does not exist (perhaps a typo or a missing channel).

bbartoldson commented 7 months ago

@jesulo, some of your errors might be fixed by following the approach suggested by @cdeepali. However, when using that suggested approach to get past the errors you found, @madmax-codewarrior-0 gets a separate error (a TypeError). There are more details on this in the slack channel that @madmax-codewarrior-0 linked to above.

jesulo commented 7 months ago

thanks @bbartoldson so still errors. I need pytorch-cuda 2.1.2

NavinKumarMNK commented 5 months ago

Is it fixed ? now is it possible to install the pytorch==2.1.2 for power9 system with cuda support ?