ai-forever / ru-gpts

Russian GPT3 models.
Apache License 2.0
2.08k stars 445 forks source link

resolved cuda and pytorch versions in rugpt3xl_generation notebook #65

Closed amrzv closed 3 years ago

amrzv commented 3 years ago

Hi! Tried to run rugpt3xl_generation notebook and got this error #49 Solved by specifying pytorch and cuda versions to be installed that was mentioned #60:

pip install torch==1.7.0+cu110 -f https://download.pytorch.org/whl/torch_stable.html
export CUDA_HOME=/usr/local/cuda-11.0

Also, this would be resolved #62

Tested in colab, notebook works as expected.

AlexanderKozhevin commented 3 years ago

@amrzv Sorry can you give some reference on how to run rugpt3xl_generation

I'm getting and error

    RuntimeError: Cuda extensions are being compiled with a version of Cuda that does not match the version used to compile Pytorch binaries.  Pytorch binaries were compiled with Cuda 11.0.
amrzv commented 3 years ago

@amrzv Sorry can you give some reference on how to run rugpt3xl_generation

I'm getting and error

    RuntimeError: Cuda extensions are being compiled with a version of Cuda that does not match the version used to compile Pytorch binaries.  Pytorch binaries were compiled with Cuda 11.0.

Hi. Please, see this comment.

Artyrm commented 3 years ago

Unfortunately, this step: !pip install deepspeed==0.3.7 overwrites torch version:

Requirement already satisfied: torch>=1.2 in /usr/local/lib/python3.7/dist-packages (from deepspeed==0.3.7) (1.7.0+cu110)
...
Collecting torch>=1.2
  Downloading torch-1.9.0-cp37-cp37m-manylinux1_x86_64.whl (831.4 MB)
     |████████████████████████████████| 831.4 MB 2.6 kB/s 
Installing collected packages: torch
  Attempting uninstall: torch
    Found existing installation: torch 1.7.0+cu110
    Uninstalling torch-1.7.0+cu110:
      Successfully uninstalled torch-1.7.0+cu110
Successfully installed torch-1.9.0

UPD guess we need to run it like this:

!pip install --no-dependencies --no-cache-dir deepspeed==0.3.7

amrzv commented 3 years ago

Seems that notebook is fixed in https://github.com/sberbank-ai/ru-gpts/commit/3b0b84b0e45386f6952dcbe7d3bea9409c1c3780