search

comfyanonymous / ComfyUI

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.
https://www.comfy.org/
GNU General Public License v3.0
52.35k stars 5.52k forks source link

CoreML intergration? #843

Open Maki9009 opened 1 year ago

Maki9009 commented 1 year ago

Any plans on allowing to run CoreML models on ur Ui? since Apple CoreML models run waay better than normal safetensors on mac.. much more faster

comfyanonymous commented 1 year ago

I would like to but I don't have a mac.

Maki9009 commented 1 year ago

I would like to but I don't have a mac.

Any way I could like help? In like being a tester or something like that? Cuz I just attempted to to generate on the SDXL model... took 45min to make 1 image. I know Coreml model doesn't exist for SDXL yet. But it would be soon and 1.5 generation are 50% faster on coreml on Mac

ZachNagengast commented 1 year ago

SDXL 1.0 will be officially supported on https://github.com/apple/ml-stable-diffusion soon, with optimized models for ANE. These can run directly from python via coremltools, so might be a good option for folks without a cuda device. Happy to help out with the integration

amitkot commented 1 year ago

@comfyanonymous is there a way now in ComfyUI to select backends? If so, a coreml backend wrapper can be plugged.