AUTOMATIC1111 / stable-diffusion-webui

Stable Diffusion web UI
GNU Affero General Public License v3.0
141.48k stars 26.74k forks source link

[Bug]: "xFormers wasn't build with CUDA support" after running with --reinstall-xformers #11905

Closed Sparkwave2 closed 1 year ago

Sparkwave2 commented 1 year ago

Is there an existing issue for this?

What happened?

I forced xformers to reinstall because it was outdated (using --reinstall-xformers) and it returned the following error:

NotImplementedError: No operator found for `memory_efficient_attention_forward` with inputs:
     query       : shape=(2, 4096, 8, 40) (torch.float32)
     key         : shape=(2, 4096, 8, 40) (torch.float32)
     value       : shape=(2, 4096, 8, 40) (torch.float32)
     attn_bias   : <class 'NoneType'>
     p           : 0.0
`flshattF` is not supported because:
    xFormers wasn't build with CUDA support
    dtype=torch.float32 (supported: {torch.float16, torch.bfloat16})
    Operator wasn't built - see `python -m xformers.info` for more info
`tritonflashattF` is not supported because:
    xFormers wasn't build with CUDA support
    dtype=torch.float32 (supported: {torch.float16, torch.bfloat16})
    Operator wasn't built - see `python -m xformers.info` for more info
    triton is not available
    requires A100 GPU
`cutlassF` is not supported because:
    xFormers wasn't build with CUDA support
    Operator wasn't built - see `python -m xformers.info` for more info
`smallkF` is not supported because:
    xFormers wasn't build with CUDA support
    max(query.shape[-1] != value.shape[-1]) > 32
    Operator wasn't built - see `python -m xformers.info` for more info
    unsupported embed per head: 40

Not sure how to fix it from here.

Steps to reproduce the problem

  1. Launch the A1111 WebUI with --xformers --reinstall-xformers
  2. Try generating an image
  3. The error "xFormers wasn't build with CUDA support" appears

What should have happened?

The image should have generated correctly using xformers.

Version or Commit where the problem happens

https://github.com/AUTOMATIC1111/stable-diffusion-webui/commit/f865d3e11647dfd6c7b2cdf90dde24680e58acd8

What Python version are you running on ?

None

What platforms do you use to access the UI ?

No response

What device are you running WebUI on?

No response

Cross attention optimization

Automatic

What browsers do you use to access the UI ?

No response

Command Line Arguments

--xformers --api --disable-safe-unpickle --no-half-vae --no-half --reinstall-xformers

List of extensions

Cozy-Nest | https://github.com/Nevysha/Cozy-Nest.git | main | 2f4964c2 | Sun Jul 2 09:03:03 2023 | unknown SD-CN-Animation | https://github.com/volotat/SD-CN-Animation.git | main | 2e257bbf | Tue May 30 16:49:03 2023 | unknown SDAtom-WebUi-client-queue-ext | https://github.com/Kryptortio/SDAtom-WebUi-client-queue-ext.git | master | 9cf161b2 | Thu Jun 1 17:41:46 2023 | unknown Stable-Diffusion-Webui-Civitai-Helper | https://github.com/butaixianran/Stable-Diffusion-Webui-Civitai-Helper.git | main | 920ca326 | Tue May 23 11:53:22 2023 | unknown a1111-sd-webui-lycoris | https://github.com/KohakuBlueleaf/a1111-sd-webui-lycoris.git | main | 8e97bf54 | Sun Jul 9 07:44:58 2023 | unknown aesthetic-gradients | https://github.com/AUTOMATIC1111/stable-diffusion-webui-aesthetic-gradients | master | 2624e5dd | Fri Jan 6 10:59:30 2023 | unknown aesthetic-image-scorer | https://github.com/tsngo/stable-diffusion-webui-aesthetic-image-scorer | main | 1c3ab7a1 | Sun Dec 11 05:52:39 2022 | unknown artists-to-study | https://github.com/camenduru/stable-diffusion-webui-artists-to-study | master | 5cd19f68 | Mon Jun 26 08:38:08 2023 | unknown booru2prompt | https://github.com/Malisius/booru2prompt.git | master | 4bd88839 | Wed Nov 23 14:41:10 2022 | unknown ddetailer | https://github.com/dustysys/ddetailer.git | master | 22a17414 | Mon Nov 28 09:33:31 2022 | unknown deforum | https://github.com/deforum-art/deforum-for-automatic1111-webui | automatic1111-webui | 858c4dd6 | Sun Jul 2 16:52:11 2023 | unknown depthmap2mask | https://github.com/Extraltodeus/depthmap2mask.git | main | 377e9224 | Thu Apr 13 04:10:08 2023 | unknown dynamic-prompts | https://github.com/adieyal/sd-dynamic-prompting/ | main | 26ce66bb | Tue Jul 18 17:52:11 2023 | unknown images-browser | https://github.com/yfszzx/stable-diffusion-webui-images-browser | main | a42c7a30 | Sat Dec 10 11:01:30 2022 | unknown infinite-zoom-automatic1111-webui | https://github.com/v8hid/infinite-zoom-automatic1111-webui.git | main | 1139764b | Wed May 3 17:08:52 2023 | unknown sd-canvas-editor | https://github.com/jtydhr88/sd-canvas-editor.git | master | 12e7f72c | Fri Jun 30 01:16:49 2023 | unknown sd-model-organizer | https://github.com/alexandersokol/sd-model-organizer.git | main | dae3299b | Sat Jun 24 14:03:50 2023 | unknown sd-pixel | https://github.com/Leodotpy/sd-pixel.git | master | ceb493db | Wed May 31 19:57:01 2023 | unknown sd-webui-controlnet | https://github.com/Mikubill/sd-webui-controlnet | main | 098f6cd8 | Tue Jul 18 05:06:14 2023 | unknown sd-webui-infinite-image-browsing | https://github.com/zanllp/sd-webui-infinite-image-browsing.git | main | d3b3599b | Thu Jul 20 19:16:11 2023 | unknown sd-webui-inpaint-anything | https://github.com/Uminosachi/sd-webui-inpaint-anything.git | main | 420835b8 | Thu Jul 20 21:35:08 2023 | unknown sd-webui-openpose-editor | https://github.com/huchenlei/sd-webui-openpose-editor.git | main | 9ed77768 | Sun Jul 16 21:22:37 2023 | unknown sd-webui-prompt-history | https://github.com/namkazt/sd-webui-prompt-history | main | bde3e95e | Sat Jul 15 06:23:45 2023 | unknown sd-webui-regional-prompter | https://github.com/hako-mikan/sd-webui-regional-prompter.git | main | 2bf0e8c1 | Thu Jul 20 16:27:14 2023 | unknown sd-webui-roop | https://github.com/s0md3v/sd-webui-roop | main | e6333fbe | Fri Jul 7 09:22:59 2023 | unknown sd-webui-text2video | https://github.com/deforum-art/sd-webui-text2video.git | main | 8f0af8c9 | Fri Jul 14 12:41:05 2023 | unknown sd-webui-txt-img-to-3d-model | https://github.com/jtydhr88/sd-webui-txt-img-to-3d-model.git | master | 33bde577 | Fri Jul 7 03:42:17 2023 | unknown stable-diffusion-webui-eyemask | https://github.com/ilian6806/stable-diffusion-webui-eyemask.git | master | 7b803a43 | Fri Jun 2 11:15:19 2023 | unknown stable-diffusion-webui-rembg | https://github.com/AUTOMATIC1111/stable-diffusion-webui-rembg.git | master | 3d9eedbb | Sun Jun 4 13:35:24 2023 | unknown stable-diffusion-webui-tokenizer | https://github.com/AUTOMATIC1111/stable-diffusion-webui-tokenizer.git | master | ac6d541c | Sat Dec 10 12:58:31 2022 | unknown wildcards | https://github.com/AUTOMATIC1111/stable-diffusion-webui-wildcards | master | 6ed81ed1 | Sat Oct 29 16:18:48 2022 | unknown LDSR | built-in | None |   | Thu Jul 20 21:49:49 2023 |   Lora | built-in | None |   | Thu Jul 20 21:49:49 2023 |   ScuNET | built-in | None |   | Thu Jul 20 21:49:49 2023 |   SwinIR | built-in | None |   | Thu Jul 20 21:49:49 2023 |   canvas-zoom-and-pan | built-in | None |   | Thu Jul 20 21:49:49 2023 |   extra-options-section | built-in | None |   | Thu Jul 20 21:49:49 2023 |   prompt-bracket-checker | built-in | None |   | Thu Jul 20 21:49:49 2023
Extension URL Branch Version Date Update Cozy-Nest https://github.com/Nevysha/Cozy-Nest.git main [2f4964c2](https://github.com/Nevysha/Cozy-Nest/commit/2f4964c24506c84c78ef1f92dbe62b7081a7ffb7) Sun Jul 2 09:03:03 2023 unknown SD-CN-Animation https://github.com/volotat/SD-CN-Animation.git main [2e257bbf](https://github.com/volotat/SD-CN-Animation/commit/2e257bbfc3b76fb1323f7b22f820981c1b9f56b2) Tue May 30 16:49:03 2023 unknown SDAtom-WebUi-client-queue-ext https://github.com/Kryptortio/SDAtom-WebUi-client-queue-ext.git master [9cf161b2](https://github.com/Kryptortio/SDAtom-WebUi-client-queue-ext/commit/9cf161b22edb81f40b86fd1ee9cf929f02e032c2) Thu Jun 1 17:41:46 2023 unknown Stable-Diffusion-Webui-Civitai-Helper https://github.com/butaixianran/Stable-Diffusion-Webui-Civitai-Helper.git main [920ca326](https://github.com/butaixianran/Stable-Diffusion-Webui-Civitai-Helper/commit/920ca3267f789a72e3225c99f069bf0be0db795d) Tue May 23 11:53:22 2023 unknown a1111-sd-webui-lycoris https://github.com/KohakuBlueleaf/a1111-sd-webui-lycoris.git main [8e97bf54](https://github.com/KohakuBlueleaf/a1111-sd-webui-lycoris/commit/8e97bf54867c25d00fc480be1ab4dae5399b35ef) Sun Jul 9 07:44:58 2023 unknown aesthetic-gradients https://github.com/AUTOMATIC1111/stable-diffusion-webui-aesthetic-gradients master [2624e5dd](https://github.com/AUTOMATIC1111/stable-diffusion-webui-aesthetic-gradients/commit/2624e5dd4902cb731287b426ad483e741ece85bb) Fri Jan 6 10:59:30 2023 unknown aesthetic-image-scorer https://github.com/tsngo/stable-diffusion-webui-aesthetic-image-scorer main [1c3ab7a1](https://github.com/tsngo/stable-diffusion-webui-aesthetic-image-scorer/commit/1c3ab7a116ab5bc3b81d718e6383edd98903a01f) Sun Dec 11 05:52:39 2022 unknown artists-to-study https://github.com/camenduru/stable-diffusion-webui-artists-to-study master [5cd19f68](https://github.com/camenduru/stable-diffusion-webui-artists-to-study/commit/5cd19f68f65e994fc2ef2700bed4d9efe28e48b4) Mon Jun 26 08:38:08 2023 unknown booru2prompt https://github.com/Malisius/booru2prompt.git master [4bd88839](https://github.com/Malisius/booru2prompt/commit/4bd88839a6454428d098c7ad6672cc0989dd6a60) Wed Nov 23 14:41:10 2022 unknown ddetailer https://github.com/dustysys/ddetailer.git master [22a17414](https://github.com/dustysys/ddetailer/commit/22a17414bbca1fa4681d427b8aae5f970d17e896) Mon Nov 28 09:33:31 2022 unknown deforum https://github.com/deforum-art/deforum-for-automatic1111-webui automatic1111-webui [858c4dd6](https://github.com/deforum-art/deforum-for-automatic1111-webui/commit/858c4dd6fd030449c23882724c67ee9398b4fd05) Sun Jul 2 16:52:11 2023 unknown depthmap2mask https://github.com/Extraltodeus/depthmap2mask.git main [377e9224](https://github.com/Extraltodeus/depthmap2mask/commit/377e9224dbdb169ede588a6d447ca886aab67140) Thu Apr 13 04:10:08 2023 unknown dynamic-prompts https://github.com/adieyal/sd-dynamic-prompting/ main [26ce66bb](https://github.com/adieyal/sd-dynamic-prompting//commit/26ce66bbac7a4c5c34d250d45c2327807fad148f) Tue Jul 18 17:52:11 2023 unknown images-browser https://github.com/yfszzx/stable-diffusion-webui-images-browser main [a42c7a30](https://github.com/yfszzx/stable-diffusion-webui-images-browser/commit/a42c7a30181636a05815e62426d5eff4d3340529) Sat Dec 10 11:01:30 2022 unknown infinite-zoom-automatic1111-webui https://github.com/v8hid/infinite-zoom-automatic1111-webui.git main [1139764b](https://github.com/v8hid/infinite-zoom-automatic1111-webui/commit/1139764bf715d848dc5b8b4c8d95e2e734c7e4eb) Wed May 3 17:08:52 2023 unknown sd-canvas-editor https://github.com/jtydhr88/sd-canvas-editor.git master [12e7f72c](https://github.com/jtydhr88/sd-canvas-editor/commit/12e7f72cdccb3ede788aa3a6f81e5c060638842d) Fri Jun 30 01:16:49 2023 unknown sd-model-organizer https://github.com/alexandersokol/sd-model-organizer.git main [dae3299b](https://github.com/alexandersokol/sd-model-organizer/commit/dae3299b2cb902873db78615b76bf28d4cfbd4e0) Sat Jun 24 14:03:50 2023 unknown sd-pixel https://github.com/Leodotpy/sd-pixel.git master [ceb493db](https://github.com/Leodotpy/sd-pixel/commit/ceb493db323b1cf425274fb32661de2ff2516f1b) Wed May 31 19:57:01 2023 unknown sd-webui-controlnet https://github.com/Mikubill/sd-webui-controlnet main [098f6cd8](https://github.com/Mikubill/sd-webui-controlnet/commit/098f6cd887ac5f6f5f0e7cc9d81460095d2be012) Tue Jul 18 05:06:14 2023 unknown sd-webui-infinite-image-browsing https://github.com/zanllp/sd-webui-infinite-image-browsing.git main [d3b3599b](https://github.com/zanllp/sd-webui-infinite-image-browsing/commit/d3b3599b73a22f742323a52da9c3db8ff56ceeda) Thu Jul 20 19:16:11 2023 unknown sd-webui-inpaint-anything https://github.com/Uminosachi/sd-webui-inpaint-anything.git main [420835b8](https://github.com/Uminosachi/sd-webui-inpaint-anything/commit/420835b8d97db95a77807a14720395a27333c972) Thu Jul 20 21:35:08 2023 unknown sd-webui-openpose-editor https://github.com/huchenlei/sd-webui-openpose-editor.git main [9ed77768](https://github.com/huchenlei/sd-webui-openpose-editor/commit/9ed7776842fd61e8acd80c37a6cc977403842056) Sun Jul 16 21:22:37 2023 unknown sd-webui-prompt-history https://github.com/namkazt/sd-webui-prompt-history main [bde3e95e](https://github.com/namkazt/sd-webui-prompt-history/commit/bde3e95e078b107efe78f0608a62b163daceb6d3) Sat Jul 15 06:23:45 2023 unknown sd-webui-regional-prompter https://github.com/hako-mikan/sd-webui-regional-prompter.git main [2bf0e8c1](https://github.com/hako-mikan/sd-webui-regional-prompter/commit/2bf0e8c14abc167a43a431a4bc181f77ff646079) Thu Jul 20 16:27:14 2023 unknown sd-webui-roop https://github.com/s0md3v/sd-webui-roop main [e6333fbe](https://github.com/s0md3v/sd-webui-roop/commit/e6333fbe5a0f3e6a515852388151f1db2315c45d) Fri Jul 7 09:22:59 2023 unknown sd-webui-text2video https://github.com/deforum-art/sd-webui-text2video.git main [8f0af8c9](https://github.com/deforum-art/sd-webui-text2video/commit/8f0af8c95a3c3a3af09c63cbdbdacc34b7a45f8d) Fri Jul 14 12:41:05 2023 unknown sd-webui-txt-img-to-3d-model https://github.com/jtydhr88/sd-webui-txt-img-to-3d-model.git master [33bde577](https://github.com/jtydhr88/sd-webui-txt-img-to-3d-model/commit/33bde577a4700be23211cb45dc9acc55b63d5311) Fri Jul 7 03:42:17 2023 unknown stable-diffusion-webui-eyemask https://github.com/ilian6806/stable-diffusion-webui-eyemask.git master [7b803a43](https://github.com/ilian6806/stable-diffusion-webui-eyemask/commit/7b803a438f02b381903916b65cc5b15c98e3231c) Fri Jun 2 11:15:19 2023 unknown stable-diffusion-webui-rembg https://github.com/AUTOMATIC1111/stable-diffusion-webui-rembg.git master [3d9eedbb](https://github.com/AUTOMATIC1111/stable-diffusion-webui-rembg/commit/3d9eedbbf0d585207f97d5b21e42f32c0042df70) Sun Jun 4 13:35:24 2023 unknown stable-diffusion-webui-tokenizer https://github.com/AUTOMATIC1111/stable-diffusion-webui-tokenizer.git master [ac6d541c](https://github.com/AUTOMATIC1111/stable-diffusion-webui-tokenizer/commit/ac6d541c7032e9f9c69c8ead2ed201302b06a4fe) Sat Dec 10 12:58:31 2022 unknown wildcards https://github.com/AUTOMATIC1111/stable-diffusion-webui-wildcards master [6ed81ed1](https://github.com/AUTOMATIC1111/stable-diffusion-webui-wildcards/commit/6ed81ed1eaee9145b596ab6385c38ffd8ce7b13f) Sat Oct 29 16:18:48 2022 unknown LDSR [built-in](http://127.0.0.1:7860/) None Thu Jul 20 21:49:49 2023 Lora [built-in](http://127.0.0.1:7860/) None Thu Jul 20 21:49:49 2023 ScuNET [built-in](http://127.0.0.1:7860/) None Thu Jul 20 21:49:49 2023 SwinIR [built-in](http://127.0.0.1:7860/) None Thu Jul 20 21:49:49 2023 canvas-zoom-and-pan [built-in](http://127.0.0.1:7860/) None Thu Jul 20 21:49:49 2023 extra-options-section [built-in](http://127.0.0.1:7860/) None Thu Jul 20 21:49:49 2023 prompt-bracket-checker [built-in](http://127.0.0.1:7860/) None Thu Jul 20 21:49:49 2023 ### Console logs ```Shell https://pastebin.com/JJDSSSnX ``` ### Additional information _No response_
Sparkwave2 commented 1 year ago

Issue fixed by completely removing and uninstalling both torch and xformers and letting the WebUI install them again.