search

Ai00-X / ai00_server

The all-in-one RWKV runtime box with embed, RAG, AI agents, and more.
https://ai00-x.github.io/ai00_server/
MIT License
485 stars 58 forks source link

ubuntu 24.04 load runtime failed: No such file or directory (os error 2) #143

Closed Alic-Li closed 2 months ago

Alic-Li commented 2 months ago

alic-li@alic-li-B660M-D2H-DDR4:~/ai00$ ./ai00-server 2024-09-09T08:17:44.881Z INFO [ai00_server] ai00_server version: 0.5.7 2024-09-09T08:17:44.881Z INFO [ai00_server] reading config assets/configs/Config.toml... tokenizer.json [00:00:02] [████████████████] 16.29 MiB/16.29 MiB 7.35 MiB/s (0s)2024-09-09T08:17:48.653Z INFO [ai00_server] loading embed model: intfloat/multilingual-e5-small onnx/model.onnx [00:00:42] [████████████] 448.48 MiB/448.48 MiB 10.60 MiB/s (0s)config.json [00:00:00] [█████████████████████████████] 655 B/655 B 1015 B/s (0s)special_tokens_map.json [00:00:00] [██████████████████] 167 B/167 B 214 B/s (0s)tokenizer_config.json [00:00:00] [████████████████████] 443 B/443 B 638 B/s (0s)2024-09-09T08:18:37.667Z ERROR [ai00_core] load runtime failed: No such file or directory (os error 2) 2024-09-09T08:18:37.701Z INFO [ai00_server] visit WebUI at http://localhost:65530 2024-09-09T08:18:37.701Z INFO [ai00_server] server started at 0.0.0.0:65530 without tls 2024-09-09T08:19:15.025Z ERROR [ai00_core] load runtime failed: No such device (os error 19)

修改模型路径后也还是一样的报错，但是奇怪的是我笔记本的22.04是好的，核显也是可以用vulkan正常运行的，进入web UI后可以认设备 VK_LAYER_INTEL_nullhw (INTEL NULL HW) Vulkan version 1.1.73, layer version 1: Layer Extensions: count = 0 Devices: count = 3 GPU id = 0 (AMD Radeon PRO W7900 (RADV NAVI31)) Layer-Device Extensions: count = 0

    GPU id = 1 (Intel(R) UHD Graphics 730 (ADL-S GT1))
    Layer-Device Extensions: count = 0

    GPU id = 2 (llvmpipe (LLVM 17.0.6, 256 bits))
            Layer-Device Extensions: count = 0

截图 2024-09-09 16-30-34 模型路径下的模型认不出来 把模型直接塞在assets/models下也无效

cgisky1980 commented 2 months ago

config 贴出来看看

cgisky1980 commented 2 months ago

用0.5.8版本试试

Alic-Li commented 2 months ago

好的，晚上回寝室试试看，我们叼毛大一新生还要军训😂

No-22-Github commented 2 months ago

同样遇到报错，0.5.8版本

./ai00-server 
2024-10-05T10:29:49.249Z INFO  [ai00_server] ai00_server        version: 0.5.8
2024-10-05T10:29:49.249Z INFO  [ai00_server] reading config assets/configs/Config.toml...
tokenizer.json [00:00:01] [████████████████████████████████████████████████████████████] 16.29 MiB/16.29 MiB 9.50 MiB/s (0s)2024-10-05T10:29:52.526Z INFO  [ai00_server] loading embed model: intfloat/multilingual-e5-small
onnx/model.onnx [00:00:43] [████████████████████████████████████████████████████████] 448.48 MiB/448.48 MiB 10.31 MiB/s (0s)config.json [00:00:00] [███████████████████████████████████████████████████████████████████████] 655 B/655 B 2.51 KiB/s (0s)special_tokens_map.json [00:00:00] [██████████████████████████████████████████████████████████████] 167 B/167 B 647 B/s (0s)tokenizer_config.json [00:00:00] [█████████████████████████████████████████████████████████████] 443 B/443 B 1.71 KiB/s (0s)2024-10-05T10:30:40.123Z ERROR [ai00_core] load runtime failed: No such file or directory (os error 2)
2024-10-05T10:30:40.179Z INFO  [ai00_server] visit WebUI at http://localhost:65530
2024-10-05T10:30:40.179Z INFO  [ai00_server] server started at 0.0.0.0:65530 without tls

但是没有影响运行，甚至我的A卡和N卡都能用。我没有改配置文件，保持默认。

Alic-Li commented 2 months ago

报错依然有，但是实测可以用，能跑就行😋 image