search

camenduru / text-generation-webui-colab

A colab gradio web UI for running Large Language Models
The Unlicense
2.08k stars 366 forks source link

ModuleNotFoundError: No module named 'transformers' #14

Closed M3rcuz1o closed 1 year ago

M3rcuz1o commented 1 year ago

The colab doesn't smoothly run through, and finally stalls with "No module named 'transformers'. This is, as I found out due to the requirements.txt beeing outdated with two modules. See fix below.

M3rcuz1o commented 1 year ago

Download Results: gid |stat|avg speed |path/URI ======+====+===========+======================================================= e621aa|OK | 170MiB/s|/content/text-generation-webui/models/vicuna-13b-GPTQ-4bit-128g/vicuna-13b-4bit-128g.safetensors

Status Legend: (OK):download completed. /content/text-generation-webui Traceback (most recent call last): File "/content/text-generation-webui/server.py", line 18, in from modules import api, chat, shared, training, ui File "/content/text-generation-webui/modules/api.py", line 6, in from modules.text_generation import generate_reply File "/content/text-generation-webui/modules/text_generation.py", line 7, in import transformers ModuleNotFoundError: No module named 'transformers'

M3rcuz1o commented 1 year ago

Changing these in requirements.txt made it work:

accelerate==0.20.3 safetensors==0.3.1

This is a quick fix for the issue: You can run the colab, let it copy the files, then stop it. Then open the colab file editor on the left, go to the folder /content/text-generation-webui/ and open requirements.txt. Then edit as above and save the file, and run the colab again. Fixed it for me. :)

camenduru commented 1 year ago

thanks for the info @M3rcuz1o ❤ please try again