search

exo-explore / exo

Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚
GNU General Public License v3.0
16.54k stars 884 forks source link

Smarter model downloading #16

Open AlexCheema opened 4 months ago

AlexCheema commented 4 months ago

See: https://github.com/exo-explore/exo/issues/14

Right now, every device downloads the entire model which is unnecessary. The design of exo makes things like this particularly difficult since all nodes are equal and p2p.

AlexCheema commented 4 months ago

Two things needed:

  1. Sticky node ids. (To keep shards sticky)
  2. Filter files to download based on shards.