search

oobabooga / one-click-installers

Simplified installers for oobabooga/text-generation-webui.
GNU Affero General Public License v3.0
550 stars 186 forks source link

Error on fresh install #66

Closed AzraelXS closed 1 year ago

AzraelXS commented 1 year ago

Hello, I performed a fresh install using the one-click installer for Windows, that is to say, I simply ran start_windows.bat and prayed the massive mountain of dependencies would be set up correctly.

I selected to set up with NVIDIA hardware (an RTX 4090), and selected not to download any models, as I'd like to use Vicuna 13B.

image

bin C:\oobabooga\installer_files\env\lib\site-packages\bitsandbytes\libbitsandbytes_cuda117.dll Traceback (most recent call last): File "C:\oobabooga\text-generation-webui\server.py", line 47, in from modules import chat, shared, training, ui, utils File "C:\oobabooga\text-generation-webui\modules\training.py", line 14, in from peft import (LoraConfig, get_peft_model, prepare_model_for_int8_training, File "C:\oobabooga\installer_files\env\lib\site-packages\peft__init.py", line 22, in from .mapping import MODEL_TYPE_TO_PEFT_MODEL_MAPPING, PEFT_TYPE_TO_CONFIG_MAPPING, get_peft_config, get_peft_model File "C:\oobabooga\installer_files\env\lib\site-packages\peft\mapping.py", line 16, in from .peft_model import ( File "C:\oobabooga\installer_files\env\lib\site-packages\peft\peft_model.py", line 31, in from .tuners import ( File "C:\oobabooga\installer_files\env\lib\site-packages\peft\tuners\init__.py", line 21, in from .lora import LoraConfig, LoraModel File "C:\oobabooga\installer_files\env\lib\site-packages\peft\tuners\lora.py", line 735, in class Linear4bit(bnb.nn.Linear4bit, LoraLayer): AttributeError: module 'bitsandbytes.nn' has no attribute 'Linear4bit'. Did you mean: 'Linear8bitLt'?

Done! Press any key to continue . . .

github-actions[bot] commented 1 year ago

This issue has been closed due to inactivity for 30 days. If you believe it is still relevant, please leave a comment below.