search

SillyTavern / SillyTavern-Launcher

Launcher scripts for SillyTavern and ST-Extras.
MIT License
217 stars 59 forks source link

Start alltalk with the start_alltalk.bat script to fix cuda not available error #52

Closed zdaar closed 6 months ago

zdaar commented 6 months ago

alltalk comes with a start_alltalk.bat script that properly prepares its environment. Running the naked python command, I get a cuda not available error image

starting it with the script, however, works fine.

image

Needs to either use start_alltalk.bat as in this pr or extend the init command to properly mirror what the batch file does

deffcolony commented 6 months ago

@zdaar Ah i already fixed this in https://github.com/SillyTavern/SillyTavern-Launcher/commit/8d05b7a0766e4b02cc1164efeeea17fec6bb08b6# by replacing the: pip install torch==2.1.2+cu121 torchaudio==2.1.2+cu121 --index-url https://download.pytorch.org/whl/cu121

into

pip install torch==2.2.0+cu121 torchaudio>=2.2.0+cu121 --upgrade --force-reinstall --extra-index-url https://download.pytorch.org/whl/cu121

it now correctly supports cuda and deepspeed