search

evilsocket / cake

Distributed LLM and StableDiffusion inference for mobile, desktop and server.
Other
2.44k stars 127 forks source link

Cross-device mapping #2

Closed b0xtch closed 2 months ago

b0xtch commented 2 months ago

Related issue/feature: https://github.com/EricLBuehler/mistral.rs/issues/395

evilsocket commented 2 months ago

mind elaborating?

b0xtch commented 2 months ago

mind elaborating?

https://github.com/evilsocket/llama3-cake/commit/c55c7056f6caf73c087d851f44adfe4895a07579

You've addressed it here nice