oobabooga / text-generation-webui

A Gradio web UI for Large Language Models.
GNU Affero General Public License v3.0
39.67k stars 5.21k forks source link

Colab will not generate share link #5946

Closed Clovisint closed 4 months ago

Clovisint commented 4 months ago

Describe the bug

The link to use Colab is not working. I get the local URL (which is useless for Colab) but get an error for the share link. Following the instructions gives me the same error, despite putting the files there myself.

Is there an existing issue for this?

Reproduction

Just try to use the Colab link, you'll see

Screenshot

No response

Logs

Downloading the model to models/TheBloke_MythoMax-L2-13B-GPTQ_gptq-4bit-32g-actorder_True
python server.py --share --model TheBloke_MythoMax-L2-13B-GPTQ_gptq-4bit-32g-actorder_True --n-gpu-layers 128 --load-in-4bit --use_double_quant
19:30:15-368497 INFO     Starting Text generation web UI                                            
19:30:15-386305 INFO     Loading "TheBloke_MythoMax-L2-13B-GPTQ_gptq-4bit-32g-actorder_True"        
19:30:37-455717 INFO     LOADER: "ExLlamav2_HF"                                                     
19:30:37-457171 INFO     TRUNCATION LENGTH: 4096                                                    
19:30:37-458292 INFO     INSTRUCTION TEMPLATE: "Alpaca"                                             
19:30:37-459265 INFO     Loaded the model in 22.07 seconds.                                         

Running on local URL:  http://127.0.0.1:7860

Could not create share link. Missing file: /usr/local/lib/python3.10/dist-packages/gradio/frpc_linux_amd64_v0.2. 

Please check your internet connection. This can happen if your antivirus software blocks the download of this file. You can install manually by following these steps: 

1. Download this file: https://cdn-media.huggingface.co/frpc-gradio-0.2/frpc_linux_amd64
2. Rename the downloaded file to: frpc_linux_amd64_v0.2
3. Move the file to this location: /usr/local/lib/python3.10/dist-packages/gradio

System Info

Google Colab link

https://colab.research.google.com/github/oobabooga/text-generation-webui/blob/main/Colab-TextGen-GPU.ipynb
ndparissos commented 4 months ago

same to me, too

talon19912 commented 4 months ago

me too

Clovisint commented 4 months ago

Fixed for me