search

lllyasviel / Omost

Your image is almost there!
Apache License 2.0
6.69k stars 401 forks source link

i get the error when running the gradio_app.py #44

Open xyxxmb opened 3 weeks ago

xyxxmb commented 3 weeks ago

output = torch.nn.functional.linear(A, F.dequantize_4bit(B, quant_state).to(A.dtype).t(), bias) RuntimeError: mat1 and mat2 shapes cannot be multiplied (332x4096 and 1x8388608)

DietDietDiet commented 3 weeks ago

same here, did u solve it?

zengjichen commented 3 weeks ago

bitsandbytes>0.43.1 will be ok,other version like 0.42 get worse