search

exo-explore / exo

Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚
GNU General Public License v3.0
10.83k stars 618 forks source link

Compatibility with Raspberry Pi #111

Open bowenjw opened 3 months ago

bowenjw commented 3 months ago

Hello,

I work for Uptime Ind. We have a Raspberry Pi Blade Cluster that we would like to run Exo on.

We attempted to get Exo running, but it returned 0 TFLOPS.

Questions:

  1. Is it possible to run Exo with CPU only?
  2. Does Exo support accelerators like HAILO or Coral?

Thank you for your assistance.

mct2611 commented 2 months ago

same issue. I try to run it with CPU only, but returned 0 TFLOPS.

brushknight commented 2 months ago

I have the same problem, have multiple Raspberry Pi 4B, 5 around and would like to try llama 3.1 on them. @AlexCheema Is it realistic to implement CPU only mode, or it requires a lot of effort?

FFAMax commented 3 weeks ago

@bowenjw please let know if any luck with connecting GPU via PCIE on Raspberry Pi in the future.