oobabooga / text-generation-webui

A Gradio web UI for Large Language Models.
GNU Affero General Public License v3.0
39.68k stars 5.21k forks source link

Installation guide not working on EndeavourOS currently. #5070

Closed korodarn closed 9 months ago

korodarn commented 9 months ago

Describe the bug

I had a previous working install on EndeavorOS in my home folder, but I deleted it and re-cloned the repo as I just couldn't resolve dependency issues between the tts (a new extension alltalk_tts) and superboogav2.

That said, it wasn't just that which was a problem because even when I wasn't trying to get that extension working I was facing similar issues with the extensions in this repo, involving chromadb 0.32.7 requested by superboogav2 and it not working together with other parts.

In any case, I decided to go ahead and just kill the folder, start fresh, and stop using my own personal conda in favor of the start_linux script that was advertised in the install guide.

So I 1) Cloned repo 2) used the start_linux script

*Note - EndeavorOS is running python 3.11.5, if that matters here.

When running start_linux, it told me it was going to install packages, seemed to have done so, mentioned it was going to use it's own internal conda to activate an env, and then proceeded to error out, as shown below.

Verifying transaction: done                                                                                                                                                                                                                                                              
Executing transaction: done                                                                                                                                                                                                                                                              
#                                                                                                                                                                                                                                                                                        
# To activate this environment, use                                                                                                                                                                                                                                                      
#
#     $ conda activate /home/korodarn/Applications/text-generation-webui/installer_files/env
#
# To deactivate an active environment, use
#
#     $ conda deactivate

Traceback (most recent call last):
  File "/mnt/home/Applications/text-generation-webui/server.py", line 4, in <module>
    from modules import shared
  File "/mnt/home/Applications/text-generation-webui/modules/shared.py", line 7, in <module>
    import yaml
ModuleNotFoundError: No module named 'yaml'

Is there an existing issue for this?

Reproduction

Try to install text-generation-webui using the installation guide on EndeavorOS

Screenshot

No response

Logs

Traceback (most recent call last):
  File "/mnt/home/Applications/text-generation-webui/server.py", line 4, in <module>
    from modules import shared
  File "/mnt/home/Applications/text-generation-webui/modules/shared.py", line 7, in <module>
    import yaml
ModuleNotFoundError: No module named 'yaml'

System Info

OS: EndeavourOS Linux x86_64 
Kernel: 6.6.7-arch1-1 
Uptime: 1 day, 5 hours, 11 mins 
Packages: 1726 (pacman), 15 (flatpak) 
Shell: zsh 5.9 
Resolution: 2560x1440, 3440x1440, 2560x1440 
DE: Plasma 5.27.10 
WM: KWin 
Theme: [Plasma], Breeze-Dark [GTK2/3] 
Icons: [Plasma], Breeze-Noir-White-Blue [GTK2/3] 
Terminal: konsole 
Terminal Font: MesloLGS Nerd Font 10 
CPU: AMD Ryzen 7 5800X (16) @ 3.800GHz 
GPU: NVIDIA GeForce RTX 3080 
Memory: 7686MiB / 32002MiB
korodarn commented 9 months ago

I've tried 12-17, 12-24, snapshot as well as current. I've also tried using pip install -r requirements.txt after the environment is activated by the installers conda environment, but I just get more module not found errors and if I try to install those I end up in dependency hell usually. I assume I need specific versions. I haven't modified start_linux to add anything to it for starting extensions/etc beyond whatever is in by default. The only thing I did was symlinked in a models folder after copying the latest models/config.yaml (I think this is the file name) into it.

Example:

Traceback (most recent call last):
  File "/mnt/home/Applications/text-generation-webui-snapshot-2023-12-17/server.py", line 4, in <module>
    import accelerate  # This early import makes Intel GPUs happy
    ^^^^^^^^^^^^^^^^^
ModuleNotFoundError: No module named 'accelerate'
korodarn commented 9 months ago

Ok, I thought for a second it might not like how I had symlinked in /mnt/home/Applications to /home/korodarn and maybe it was not seeing the symlinked items in some places... and apparently that was it. I had pushed some things out of my home folder for a reinstall months ago, and I haven't had a problem with that till now, so it's a bit odd.