Error out of memory at line 88 in file D:\a\bitsandbytes-windows-webui\bitsandbytes-windows-webui\csrc\ops.cu

jllllll / bitsandbytes-windows-webui

Windows compile of bitsandbytes for use in text-generation-webui.

MIT License

344 stars 35 forks source link

Open msh01 opened 1 year ago

msh01 commented 1 year ago

然而我只是用baichuan处理一个10kb左右的文件，居然也会oom

yoinked-h commented 1 year ago

system or gpu have too few ram, try closing apps; if this doesnt work youre out of luck