Open da-moon opened 2 months ago
Thanks for the detailed issue.
Definitely needed. I'm working on quite a big refactor right now which will improve the experience on Linux, and will update docs afterwards. Here's the working branch if you're interested: https://github.com/exo-explore/exo/pull/124
Description of Request
exo
on Linux nodesReason or Need for Feature
Design / Proposal
README.md
doc or add a page to Wiki, giving step-by-step walkthrough on how to setup a cluster on Linux machineexamples/
, showing how one can useexo
to runllama 3.1
Build Information
706488732fccd22e5b456091f833b0d77c46a340
Additional Context
python3 main.py
, it started the server but didn't give me any ports.examples/llama3_distributed.py
while removing refrences to mlx but I couldn't get it to work