oobabooga / text-generation-webui

A Gradio web UI for Large Language Models.
GNU Affero General Public License v3.0
40.57k stars 5.31k forks source link

start_macos.sh fails on unabling to find torch version #6102

Open sadovsf opened 5 months ago

sadovsf commented 5 months ago

Describe the bug

When i run mentioned script it fails with following output:

What is your GPU?

A) NVIDIA
B) AMD (Linux/MacOS only. Requires ROCm SDK 5.6 on Linux)
C) Apple M Series
D) Intel Arc (IPEX)
N) None (I want to run models in CPU mode)

Input> b

*******************************************************************
* Installing PyTorch.
*******************************************************************

Collecting package metadata (current_repodata.json): done
Solving environment: done

==> WARNING: A newer version of conda exists. <==
  current version: 23.3.1
  latest version: 24.5.0

Please update conda by running

    $ conda update -n base -c defaults conda

Or to minimize the number of packages updated during conda update use

     conda install conda=24.5.0

# All requested packages already installed.

Looking in indexes: https://download.pytorch.org/whl/rocm5.6
ERROR: Could not find a version that satisfies the requirement torch== (from versions: none)
ERROR: No matching distribution found for torch==
Command '. "/Users/sadovsf/textgen/installer_files/conda/etc/profile.d/conda.sh" && conda activate "/Users/sadovsf/textgen/installer_files/env" && conda install -y -k ninja git && python -m pip install torch== torchvision==0.17.1 torchaudio==2.2.1 --index-url https://download.pytorch.org/whl/rocm5.6 && python -m pip install py-cpuinfo==9.0.0' failed with exit status code '1'.

Exiting now.
Try running the start/update script again.

Is there an existing issue for this?

Reproduction

Simply run script choosing B for AMD

Screenshot

No response

Logs

What is your GPU?

A) NVIDIA
B) AMD (Linux/MacOS only. Requires ROCm SDK 5.6 on Linux)
C) Apple M Series
D) Intel Arc (IPEX)
N) None (I want to run models in CPU mode)

Input> b

*******************************************************************
* Installing PyTorch.
*******************************************************************

Collecting package metadata (current_repodata.json): done
Solving environment: done

==> WARNING: A newer version of conda exists. <==
  current version: 23.3.1
  latest version: 24.5.0

Please update conda by running

    $ conda update -n base -c defaults conda

Or to minimize the number of packages updated during conda update use

     conda install conda=24.5.0

# All requested packages already installed.

Looking in indexes: https://download.pytorch.org/whl/rocm5.6
ERROR: Could not find a version that satisfies the requirement torch== (from versions: none)
ERROR: No matching distribution found for torch==
Command '. "/Users/sadovsf/textgen/installer_files/conda/etc/profile.d/conda.sh" && conda activate "/Users/sadovsf/textgen/installer_files/env" && conda install -y -k ninja git && python -m pip install torch== torchvision==0.17.1 torchaudio==2.2.1 --index-url https://download.pytorch.org/whl/rocm5.6 && python -m pip install py-cpuinfo==9.0.0' failed with exit status code '1'.

Exiting now.
Try running the start/update script again.

System Info

MacBook Pro
CPU: Intel Core i9
GPU: AMD Radeon Pro 5500M 8 GB
RAM: 32 GB 2667 MHz DDR4

OS: macOS Sonoma Verze 14.5 (23F79)
laurent22 commented 3 months ago

Same error here, did you manage to get it working?

Malumen commented 1 month ago

Same error macOS 13.3.6 RX 6950 XT