search

exo-explore / exo

Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚
GNU General Public License v3.0
16.01k stars 847 forks source link

Rocm support planned #434

Open DominicBoettger opened 1 week ago

DominicBoettger commented 1 week ago

As I love using Radeons under Linux I would happy to see rocm support. Do you plan to support rocm/AMD in the future?

marcussacana commented 1 week ago

I want it too, this project is a light for the overpriced GPUs.

BatSmacker84 commented 1 week ago

I am using a Radeon RX 7800XT under Linux to run exo and (from my novice perspective) it appears like exo is properly utilizing my GPU. I have no idea if this is "proper" ROCm support on exo's part or if it is running through a translation layer of some kind. Clarification by the main developer on the matter would be nice, as well as updated documentation on how/if exo supports ROCm/AMD GPUs and how to install and run exo with an AMD GPU.

If this issue is about exo not properly recognizing AMD GPU info (ie. name/model and performance), then PR #417 is my attempt at allowing exo to gather capability info for AMD GPUs. However, this is entirely cosmetic because even without that PR my GPU is utilized by exo.

Not trying to dismiss the issue, I just think a little clarification on what the issue is would be helpful to solve it.