googlecolab / colabtools

Python libraries for Google Colaboratory
Apache License 2.0
2.12k stars 696 forks source link

Upgrading PyTorch to v2.3.1 and torchvision to v0.18.1 and torchaudio to v2.3.1 #4484

Open atalman opened 3 months ago

atalman commented 3 months ago

Revised this issue in favor of release 2.3: https://github.com/googlecolab/colabtools/issues/4484#issuecomment-2075806695

Hello,

Same as this one: https://github.com/googlecolab/colabtools/issues/4344

We released

pytorch v2.2.2 torchvision v0.17.2 torchaudio v2.2.2

The wheel installation instructions are.

pytorch

Install command for CUDA 12.1 environment:

pip install torch==2.2.2

Project link: https://pypi.org/project/torch/2.2.2/#files

torchvision

Install command for CUDA 12.1 environment:

pip install torchvision==0.17.2

https://pypi.org/project/torchvision/0.17.2/#files

torchaudio

Install command for CUDA 12.1 environment:

pip install torchaudio==2.2.2

https://pypi.org/project/torchaudio/2.2.2/#files

Other notes If you require wheels for Python 3.8, 3.9, 3.10, 3.11 or 3.12. We support CPU, CUDA 11.8 and CUDA 12.1 Compute Plaforms. You can find the links here: download.pytorch.org/whl/torch_stable.html

We're looking to having it updated in Colab.

Thanks very much.

cc'ing @colaboratory-team @mayankmalik-colab @malfet @seemethere

mayankmalik-colab commented 3 months ago

Internally tracked at b/332896908 .

atalman commented 2 months ago

@mayankmalik-colab and @EvanWiederspan We released 2.3.0 version, Please update to this version!

We released

pytorch v2.3.0 torchvision v0.18.0 torchaudio v2.3.0

The wheel installation instructions are.

pytorch

Install command for CUDA 12.1 environment:

pip install torch==2.3.0

Project link: https://pypi.org/project/torch/2.3.0/#files

torchvision

Install command for CUDA 12.1 environment:

pip install torchvision==0.18.0

https://pypi.org/project/torchvision/0.18.0/#files

torchaudio

Install command for CUDA 12.1 environment:

pip install torchaudio==2.3.0

https://pypi.org/project/torchaudio/2.3.0/#files

Other notes If you require wheels for Python 3.8, 3.9, 3.10, 3.11 or 3.12. We support CPU, CUDA 11.8 and CUDA 12.1 Compute Plaforms. You can find the links here: download.pytorch.org/whl/torch_stable.html

cperry-goog commented 1 month ago

@atalman community is reporting 2.3 doesn't recognize T4s: https://x.com/danielhanchen/status/1792985678030221464

sagelywizard commented 1 month ago

More specifically, compiled models crash when doing bfloat16 ops on T4 (because it has compute capability < 8.0, IIUC). I left a comment in this issue: https://github.com/pytorch/pytorch/issues/118122 Unclear to me why this just started happening, but perhaps something was added recently in triton. For what it's worth, XLA casts these ops to float32. Which is obviously way slower, but perhaps it's a better UX than just crashing.

atalman commented 1 month ago

Updating this task since we released v2.3.1 :

pytorch v2.3.1 torchvision v0.18.1 torchaudio v2.3.1

The wheel installation instructions are.

pytorch

Install command for CUDA 12.1 environment:

pip install torch==2.3.1

Project link: https://pypi.org/project/torch/2.3.1/#files

torchvision

Install command for CUDA 12.1 environment:

pip install torchvision==0.18.1

https://pypi.org/project/torchvision/0.18.1/#files

torchaudio

Install command for CUDA 12.1 environment:

pip install torchaudio==2.3.1

https://pypi.org/project/torchaudio/2.3.1/#files

robpetrosino commented 2 weeks ago

Hi, I can't seem to install torch 2.3.1 on my machine (macOS 14.3.1). I have python 3.12.4, but I keep getting the error

pip install torch==2.3.1
ERROR: Could not find a version that satisfies the requirement torch==2.3.1 (from versions: 2.2.0, 2.2.1, 2.2.2)
ERROR: No matching distribution found for torch==2.3.1

I tried googling this, but can't find a working solution. Can anyone help?

kiukchung commented 1 week ago

Hi, I can't seem to install torch 2.3.1 on my machine (macOS 14.3.1). I have python 3.12.4, but I keep getting the error

pip install torch==2.3.1
ERROR: Could not find a version that satisfies the requirement torch==2.3.1 (from versions: 2.2.0, 2.2.1, 2.2.2)
ERROR: No matching distribution found for torch==2.3.1

I tried googling this, but can't find a working solution. Can anyone help?

haven't tried with python-3.12.4 but I'm able to install torch-2.3.1 on my mac in python-3.11.4

(venv311) kiuk@kiuk-macbookpro1(main|✔)% pip install torch==2.3.1                                                                                                                                                                                                                 
Collecting torch==2.3.1
  Using cached torch-2.3.1-cp311-none-macosx_11_0_arm64.whl (61.0 MB)
Requirement already satisfied: filelock in /Users/kiuk/.pyenv/versions/3.11.4/envs/venv311/lib/python3.11/site-packages (from torch==2.3.1) (3.15.4)
Requirement already satisfied: typing-extensions>=4.8.0 in /Users/kiuk/.pyenv/versions/3.11.4/envs/venv311/lib/python3.11/site-packages (from torch==2.3.1) (4.12.2)
Requirement already satisfied: sympy in /Users/kiuk/.pyenv/versions/3.11.4/envs/venv311/lib/python3.11/site-packages (from torch==2.3.1) (1.12.1)
Requirement already satisfied: networkx in /Users/kiuk/.pyenv/versions/3.11.4/envs/venv311/lib/python3.11/site-packages (from torch==2.3.1) (3.3)
Requirement already satisfied: jinja2 in /Users/kiuk/.pyenv/versions/3.11.4/envs/venv311/lib/python3.11/site-packages (from torch==2.3.1) (3.1.4)
Requirement already satisfied: fsspec in /Users/kiuk/.pyenv/versions/3.11.4/envs/venv311/lib/python3.11/site-packages (from torch==2.3.1) (2024.6.1)
Requirement already satisfied: MarkupSafe>=2.0 in /Users/kiuk/.pyenv/versions/3.11.4/envs/venv311/lib/python3.11/site-packages (from jinja2->torch==2.3.1) (2.1.5)
Requirement already satisfied: mpmath<1.4.0,>=1.1.0 in /Users/kiuk/.pyenv/versions/3.11.4/envs/venv311/lib/python3.11/site-packages (from sympy->torch==2.3.1) (1.3.0)
Installing collected packages: torch
Successfully installed torch-2.3.1

[notice] A new release of pip is available: 23.1.2 -> 24.1.1
[notice] To update, run: python3.11 -m pip install --upgrade pip

(venv311) kiuk@kiuk-macbookpro1(main|✔)% python --version                                                                                                                                                                                                                         
Python 3.11.4