Support MPI distribute computation over machine cluster

wangzhaode / mnn-llm

llm deploy project based mnn.

Apache License 2.0

1.46k stars 159 forks source link

Support MPI distribute computation over machine cluster #184

Closed hyperbolic-c closed 5 months ago

hyperbolic-c commented 6 months ago

Is it possible to use MPI to distribute the computation over a cluster of machines ? This feature let us deploy larger models than would otherwise fit into RAM on a single machine. Thanks for your reply.

github-actions[bot] commented 5 months ago

Marking as stale. No activity in 30 days.