Open light-and-ray opened 11 months ago
p.s. I've done --reinstall-xformers
before write this issue
NotImplementedError: No operator found for
memory_efficient_attention_forward
with inputs: query : shape=(1, 64, 5, 64) (torch.float32) key : shape=(1, 64, 5, 64) (torch.float32) value : shape=(1, 64, 5, 64) (torch.float32) attn_bias : <class 'NoneType'> p : 0.0decoderF
is not supported because: device=cpu (supported: {'cuda'}) attn_bias type is <class 'NoneType'>
Also sd_hijack_optimizations.py:497:
out = xformers.ops.memory_efficient_attention(q, k, v, attn_bias=None, op=get_xformers_flash_attention_op(q, k, v))
But there are other is not supported because
:
decoderF
is not supported because: device=cpu (supported: {'cuda'}) attn_bias type is <class 'NoneType'>flshattF@v2.3.6
is not supported because: device=cpu (supported: {'cuda'}) dtype=torch.float32 (supported: {torch.float16, torch.bfloat16})tritonflashattF
is not supported because: device=cpu (supported: {'cuda'}) dtype=torch.float32 (supported: {torch.float16, torch.bfloat16}) operator wasn't built - seepython -m xformers.info
for more info triton is not available Only work on pre-MLIR triton for nowcutlassF
is not supported because: device=cpu (supported: {'cuda'})smallkF
is not supported because: max(query.shape[-1] != value.shape[-1]) > 32 device=cpu (supported: {'cuda'}) unsupported embed per head: 64
Is there an existing issue for this?
What happened?
I start webui with not sd 2.1 model, then I try to load sd 2.1 checkpoint, and I get "NotImplementedError"
In the example below I loaded webui with previous used
realisticVisionV51_v51VAE.safetensors
(sd 1.5), and after that I switched model onsd_v2-1_768-ema-pruned.safetensors
Unsuccessful switching
It is possible to load the model with no using
--xformers
(but in this case sd 2.1 requires --no-half argument, аnd it is disaster), or using--xformers
, if 2.1 was the last used modelOr I can just provide
--ckpt models/Stable-diffusion/sd_v2-1_768-ema-pruned.safetensors
argument:Successful load on startup
And the model works. And I can switch them with no problems
Steps to reproduce the problem
What should have happened?
error
Sysinfo
sysinfo-2023-10-25-19-14.txt
sysinfo ignored --disable-all-extensions for some reason ("disable_all_extensions": "none",)
What browsers do you use to access the UI ?
Mozilla Firefox
Console logs
Additional information
No response