search

pytorch / builder

Continuous builder and binary build scripts for pytorch
BSD 2-Clause "Simplified" License
323 stars 212 forks source link

Are cuda aarch64 build available anywhere? #1856

Open gdippolito opened 4 weeks ago

gdippolito commented 4 weeks ago

Hello,

I'm interested in trying out a Pytorch build for CUDA 12.4 and aarch64 architecture.

Are those available anywhere?

Thanks,

nWEIdia commented 3 weeks ago

Yes, you can use pip3 install --pre torch --index-url https://download.pytorch.org/whl/nightly/cu124 (we are actively developing and maintaining it, e.g. tomorrow the wheel will feature cudnn v9).

As an alternative, below is a binary that has been verified as of now that you can just wget it.

https://download.pytorch.org/whl/nightly/cu124/torch-2.4.0.dev20240606%2Bcu124-cp310-cp310-linux_aarch64.whl If you use other python version, we support 3.8 -> 3.12.

As an example: you can use ubuntu:22.04 container (on arm) to use the above command, apt update && apt install python3 python3-pip python3-venv apt-get install libopenblas-dev (required for libgFortran.so)

cc @tinglvv @ptrblck @atalman

gdippolito commented 3 weeks ago

Thanks! If I want to use a release tag what would the URL be? For example I would like to use 2.3.0 with CUDA 12.4 for aarch64. Would that be available somewhere?

nWEIdia commented 3 weeks ago

Currently CUDA 12.4 for aarch64 is only available in nightly. p.s. cuda 12.4 support was only added after v2.3.0, so it is not possible to use cuda12.4 with 2.3.0. There is a very good likelihood that v2.4.0 in short future could have cuda 12.4 aarch64 binary.