pharmapsychotic / clip-interrogator-ext

Stable Diffusion WebUI extension for CLIP Interrogator
MIT License
490 stars 62 forks source link

Does this plugin work on Apple M1? #6

Open XiaoYao-0 opened 1 year ago

XiaoYao-0 commented 1 year ago

I have installed and successfully run Stable Diffusion WebUI on my Apple M1 computer, after successfully installing this plugin, I cannot use this plugin, Python3 will crash and exit after clicking button Generate, the WebUI's log shows the following:

...
Loading CLIP Interrogator 0.5.4...
Loading BLIP model...
load checkpoint from https://storage.googleapis.com/sfr-vision-language-research/BLIP/models/model_large_caption.pth
Loading CLIP model...
Loaded CLIP model and data in 5.56 seconds.
2023-02-23 12:07:07.519 Python[16268:467906] Error getting visible function:
 (null) Function floorOp_i64 was not found in the library
/AppleInternal/Library/BuildRoots/a0876c02-1788-11ed-b9c4-96898e02b808/Library/Caches/com.apple.xbs/Sources/MetalPerformanceShaders/MPSCore/Utility/MPSKernelDAG.mm:755: failed assertion `Error getting visible function:
 (null) Function floorOp_i64 was not found in the library'
zsh: abort      ./webui.sh

This appears to be an OS architecture issue? Is it possible to get a solution? Thanks!

pharmapsychotic commented 1 year ago

sorry for the trouble, i've not run it on a mac before. hmm looks like open_clip may be using some operation not available in MPS 🤔 i'll have to try it out on mac and see. you should be able to delete the folder in your extensions folder to get back up and running. sorry it didn't work for you and thanks for the report!!

925-Studio commented 1 year ago

sorry for the trouble, i've not run it on a mac before. hmm looks like open_clip may be using some operation not available in MPS 🤔 i'll have to try it out on mac and see. you should be able to delete the folder in your extensions folder to get back up and running. sorry it didn't work for you and thanks for the report!!

Hello there, thanks for making this extension. But same thing happened to me either. It seems not suitable for arm64 mac. When I hit the 'generate' button, it keeps showing me this in terminal: MPS: does not support floor_divide op with int64 input

edwios commented 1 year ago

Same here, got MPS: does not support floor_divide op with int64 input right after it said Loaded CLIP model and data in 4.28 seconds

It is working perfectly after upgraded to 13.3 and the latest torch nightly build (torch-2.1.0.dev20230329).

sevakode commented 1 year ago

~Same here, got MPS: does not support floor_divide op with int64 input right after it said Loaded CLIP model and data in 4.28 seconds~

It is working perfectly after upgraded to 13.3 and the latest torch nightly build (torch-2.1.0.dev20230329).

didn't help me