search

exo-explore / exo

Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚
GNU General Public License v3.0
6.56k stars 342 forks source link

the exo reasoning results are messy #188

Open fangxuezheng opened 2 weeks ago

fangxuezheng commented 2 weeks ago

device info: 5 Android devices+1 windows WSL There is no error message in the log, but the output result is confusing,Can you help analyze what caused this？ thank you

image image
fangxuezheng commented 2 weeks ago

The list of Llama3 8B model files is as follows：

image
AlexCheema commented 2 weeks ago

Thanks for reporting this. Cool you have 5 Linux boxes set up.

Can you run on one of the nodes with DEBUG=6 and paste the logs here? This is definitely a bug.

fangxuezheng commented 2 weeks ago
image image
AlexCheema commented 2 weeks ago

Does this work when you run on 2 of the CLANG boxes only?

I can't reproduce on my end, wondering if it's some edge case when running with more nodes with the tinygrad backend. Never tested tinygrad backend with more than 2 devices.

HysenX-LI commented 2 weeks ago

Hello, I've been trying to run this project on the Linux platform as well, but it seems that I've encountered some compatibility issues with tinygrad, which has prevented successful execution. May I inquire which version of Linux you are using?

JKYtydt commented 1 week ago

@fangxuezheng 您好，请问您使用的是本地模型么，如果是的话您能分享一下是怎么设置的么