search

lshqqytiger / stable-diffusion-webui-amdgpu-forge

Forge for stable-diffusion-webui-amdgpu (formerly stable-diffusion-webui-directml)
GNU Affero General Public License v3.0
55 stars 4 forks source link

Error named symbol not found at line 90 in file D:\a\bitsandbytes\bitsandbytes\csrc\ops.cu #16

Open saintremy1 opened 2 months ago

saintremy1 commented 2 months ago

I'm getting this error and I don't know what to do

pinea00 commented 2 months ago

Is flux in NF4 format? This is also the case when I use zluda~~zluda does not support NF4 int4....😥

saintremy1 commented 2 months ago

I think you're absolutely right! Though, I'm unable to get any flux model working. Every one brings up TypeError: 'NoneType' object is not iterable

pinea00 commented 2 months ago

flux1-dev-fp8.safetensors works fine for a very, very long time🐌

pinea00 commented 2 months ago

If you are using a GPU above RX6600, you can try Flux (Swap Method: Asyn) in gguf format. It is a little faster. (It would be better if vulkan can be used to reason about gguf)

VeteranXT commented 2 months ago

If anyone wonders Here is zluda compatibility models image

VeteranXT commented 13 hours ago

float8-e5m2 and float8-e4m3fn works fine, It reduced time to render 1024x1024 XL model from 1m 30s to 50s -55s.