search

exo-explore / exo

Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚
GNU General Public License v3.0
15.97k stars 845 forks source link

Bug on Linux - Clang #464

Open johnykes opened 1 week ago

johnykes commented 1 week ago

Tried with all Llama models + tiny UI and I always get this. No other errors in exo terminal

Error: Failed to fetch completions: Error processing prompt (see logs with DEBUG>=2): Command '['clang', '-shared', '-march=native', '-O2', '-Wall', '-Werror', '-x', 'c', '-fPIC', '-ffreestanding', '-nostdlib', '-', '-o', '/tmp/tmplghq47j4']' returned non-zero exit status 1.
veyselsahin commented 1 week ago

how about sharing the debug log?

AlexCheema commented 1 week ago

We really need to spend some time pinning this down. Happening quite a bit https://github.com/exo-explore/exo/issues/458 It's a mystery because we don't have the logs from clang.

I think we might need to test on a bunch of different hardware and dig in.