evilsocket / cake

Distributed LLM and StableDiffusion inference for mobile, desktop and server.
Other
2.44k stars 127 forks source link

Need support for fine-tuning glm and more fine-tuning models #24

Open shenkunlovecoding opened 1 month ago

shenkunlovecoding commented 1 month ago

Thank you to the author for creating such a great inference framework By the way, Windows Cuda compiles normally Hope to support finetuned models I am using a translator