search

exo-explore / exo

Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚
GNU General Public License v3.0
6.56k stars 342 forks source link

Aborted (Core dumped) with Symbol not found __gnu_f2h_ieee #179

Closed HysenX-LI closed 2 weeks ago

HysenX-LI commented 2 weeks ago

I run the project on the Ubuntu18.04 and get a Aborted (Core dumped) error. With using DEBUG=9 python -X faulthandler main.py, I got the following error message. Is the llvmlite module required? It's not in setup.py, but it needs to be used by tinygrad. Is there any way to solve this problem? Thank you

LLVM ERROR: Symbol not found: __gnu_f2h_ieee Fatal Python error: Aborted

Thread 0x00007fe0f17fa700 (most recent call first): File "/root/anaconda3/envs/exo/lib/python3.12/concurrent/futures/thread.py", line 89 in _worker File "/root/anaconda3/envs/exo/lib/python3.12/threading.py", line 1010 in run File "/root/anaconda3/envs/exo/lib/python3.12/threading.py", line 1073 in _bootstrap_inner File "/root/anaconda3/envs/exo/lib/python3.12/threading.py", line 1030 in _bootstrap

Thread 0x00007fe0f1ffb700 (most recent call first): File "/root/anaconda3/envs/exo/lib/python3.12/concurrent/futures/thread.py", line 89 in _worker File "/root/anaconda3/envs/exo/lib/python3.12/threading.py", line 1010 in run File "/root/anaconda3/envs/exo/lib/python3.12/threading.py", line 1073 in _bootstrap_inner File "/root/anaconda3/envs/exo/lib/python3.12/threading.py", line 1030 in _bootstrap

Thread 0x00007fe0f27fc700 (most recent call first): File "/root/anaconda3/envs/exo/lib/python3.12/concurrent/futures/thread.py", line 89 in _worker File "/root/anaconda3/envs/exo/lib/python3.12/threading.py", line 1010 in run File "/root/anaconda3/envs/exo/lib/python3.12/threading.py", line 1073 in _bootstrap_inner File "/root/anaconda3/envs/exo/lib/python3.12/threading.py", line 1030 in _bootstrap

Thread 0x00007fe0f2ffd700 (most recent call first): File "/root/anaconda3/envs/exo/lib/python3.12/concurrent/futures/thread.py", line 89 in _worker File "/root/anaconda3/envs/exo/lib/python3.12/threading.py", line 1010 in run File "/root/anaconda3/envs/exo/lib/python3.12/threading.py", line 1073 in _bootstrap_inner File "/root/anaconda3/envs/exo/lib/python3.12/threading.py", line 1030 in _bootstrap

Thread 0x00007fe0f37fe700 (most recent call first): File "/root/anaconda3/envs/exo/lib/python3.12/concurrent/futures/thread.py", line 89 in _worker File "/root/anaconda3/envs/exo/lib/python3.12/threading.py", line 1010 in run File "/root/anaconda3/envs/exo/lib/python3.12/threading.py", line 1073 in _bootstrap_inner File "/root/anaconda3/envs/exo/lib/python3.12/threading.py", line 1030 in _bootstrap

Thread 0x00007fe0f3fff700 (most recent call first): File "/root/anaconda3/envs/exo/lib/python3.12/concurrent/futures/thread.py", line 89 in _worker File "/root/anaconda3/envs/exo/lib/python3.12/threading.py", line 1010 in run File "/root/anaconda3/envs/exo/lib/python3.12/threading.py", line 1073 in _bootstrap_inner File "/root/anaconda3/envs/exo/lib/python3.12/threading.py", line 1030 in _bootstrap

Thread 0x00007fe1177fe700 (most recent call first): File "/root/anaconda3/envs/exo/lib/python3.12/threading.py", line 1010 in run File "/root/anaconda3/envs/exo/lib/python3.12/threading.py", line 1073 in _bootstrap_inner File "/root/anaconda3/envs/exo/lib/python3.12/threading.py", line 1030 in _bootstrap

Current thread 0x00007fe1dde20080 (most recent call first): File "/root/anaconda3/envs/exo/lib/python3.12/site-packages/llvmlite/binding/ffi.py", line 192 in call File "/root/anaconda3/envs/exo/lib/python3.12/site-packages/llvmlite/binding/executionengine.py", line 163 in add_object_file File "/root/anaconda3/envs/exo/lib/python3.12/site-packages/tinygrad/runtime/ops_llvm.py", line 24 in init File "/root/anaconda3/envs/exo/lib/python3.12/site-packages/tinygrad/engine/realize.py", line 83 in init File "/root/anaconda3/envs/exo/lib/python3.12/site-packages/tinygrad/engine/realize.py", line 164 in get_runner File "/root/anaconda3/envs/exo/lib/python3.12/site-packages/tinygrad/engine/realize.py", line 194 in lower_schedule_item File "/root/anaconda3/envs/exo/lib/python3.12/site-packages/tinygrad/engine/realize.py", line 210 in lower_schedule File "/root/anaconda3/envs/exo/lib/python3.12/site-packages/tinygrad/engine/realize.py", line 223 in run_schedule File "/root/anaconda3/envs/exo/lib/python3.12/site-packages/tinygrad/tensor.py", line 203 in realize File "/root/anaconda3/envs/exo/lib/python3.12/site-packages/tinygrad/tensor.py", line 3166 in _wrapper File "/root/anaconda3/envs/exo/lib/python3.12/site-packages/tinygrad/nn/state.py", line 129 in load_state_dict File "/home/user/exo/exo/inference/tinygrad/inference.py", line 47 in build_transformer File "/home/user/exo/exo/inference/tinygrad/inference.py", line 93 in ensure_shard File "/home/user/exo/exo/inference/tinygrad/inference.py", line 57 in infer_prompt File "/home/user/exo/exo/orchestration/standard_node.py", line 137 in _process_prompt File "/home/user/exo/exo/orchestration/standard_node.py", line 101 in process_prompt File "/home/user/exo/exo/api/chatgpt_api.py", line 244 in handle_post_chat_completions File "/home/user/exo/exo/api/chatgpt_api.py", line 184 in middleware File "/root/anaconda3/envs/exo/lib/python3.12/site-packages/aiohttp/web_middlewares.py", line 114 in impl File "/root/anaconda3/envs/exo/lib/python3.12/site-packages/aiohttp/web_app.py", line 537 in _handle File "/root/anaconda3/envs/exo/lib/python3.12/site-packages/aiohttp/web_protocol.py", line 459 in _handle_request File "/root/anaconda3/envs/exo/lib/python3.12/asyncio/events.py", line 88 in _run File "/root/anaconda3/envs/exo/lib/python3.12/asyncio/base_events.py", line 1987 in _run_once File "/root/anaconda3/envs/exo/lib/python3.12/asyncio/base_events.py", line 641 in run_forever File "/root/anaconda3/envs/exo/lib/python3.12/asyncio/base_events.py", line 674 in run_until_complete File "/home/user/exo/main.py", line 192 in