search

evilsocket / cake

Distributed LLM and StableDiffusion inference for mobile, desktop and server.
Other
2.44k stars 127 forks source link

Add support for single model model.safetensors. #18

Closed yaojunluo closed 1 month ago

yaojunluo commented 1 month ago

Support small and medium-sized models

evilsocket commented 1 month ago

amazing! thank you so much