search

evilsocket / cake

Distributed LLM and StableDiffusion inference for mobile, desktop and server.
Other
2.44k stars 127 forks source link

Use hf_hub crate to pull model #15

Open b0xtch opened 1 month ago

b0xtch commented 1 month ago

I have a working version

evilsocket commented 1 month ago

@b0xtch is it for the master or for the worker? the idea is to split the model so who's downloading it?