[Errno 2] No such file or directory: './model/llm.mnn'

[wwwsss-g]

root@dsw-415928-84f5cf9545-jzswp:/mnt/workspace/hj# llmexport --path ./qwen2_1.5b_sft_with_wsg2 --export mnn --dst_path ./model/model --quant_bit 4 --quant_block 128 ⠋ load pretrained model Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.

✅ Done load pretrained model ./qwen2_1.5b_sft_with_wsg2 [ 2.89 s] ✅ Done export tokenizer to ./model/model/tokenizer.txt [ 0.15 s] ✅ Done export config to ./model/model/llm_config.json [ 0.00 s] ✅ Done export embedding to ./model/model/embeddings_bf16.bin [ 0.26 s] ✅ Done export onnx model to ./model/model/llm.onnx [ 3.02 s] ✅ Done slim the graph of ./model/model/llm.onnx [ 3.71 s] 💥 Failed convert onnx model to [Errno 2] No such file or directory: './model/model/llm.mnn'

[wwwsss-g]

无法转换mnn模型后，尝试手动转，报错如下，任何模型都无法转mnn root@dsw-415928-84f5cf9545-jzswp:/mnt/workspace/hj# mnnconvert -f ONNX --modelFile /mnt/workspace/hj/model/model/llm.onnx --MNNModel llm.mnn --weightQuantBits=4 --weightQuantBlock 128 --transformerFuse=1 --saveExternalData The device supports: i8sdot:0, fp16:0, i8mm: 0, sve2: 0 The device supports: i8sdot:0, fp16:0, i8mm: 0, sve2: 0 Don't has bizCode, use MNNTest for default Start to Convert Other Model Format To MNN Model..., target version: 2.9 [08:50:22] :46: ONNX Model ir version: 10 [08:50:22] :47: ONNX Model opset version: 15 [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data [08:50:22] :241: Fail to open external data: /mnt/workspace/hj/model/model/./model/model/llm.onnx.data Start to Optimize the MNN Net... 段错误

[wwwsss-g]

⠹ convert onnx model to The device supports: i8sdot:0, fp16:0, i8mm: 0, sve2: 0 The device supports: i8sdot:0, fp16:0, i8mm: 0, sve2: 0 Not support option: allowCustomOp Don't has bizCode, use MNNTest for default Start to Convert Other Model Format To MNN Model..., target version: 2.9 [08:06:27] :46: ONNX Model ir version: 10 [08:06:27] :47: ONNX Model opset version: 15 Start to Optimize the MNN Net... Fuse Attention as /Reshape_8_output_0 Fuse Attention as /Reshape_17_output_0 Fuse Attention as /Reshape_26_output_0 Fuse Attention as /Reshape_35_output_0 Fuse Attention as /Reshape_44_output_0 Fuse Attention as /Reshape_53_output_0 Fuse Attention as /Reshape_62_output_0 Fuse Attention as /Reshape_71_output_0 Fuse Attention as /Reshape_80_output_0 Fuse Attention as /Reshape_89_output_0 Fuse Attention as /Reshape_98_output_0 Fuse Attention as /Reshape_107_output_0 Fuse Attention as /Reshape_116_output_0 Fuse Attention as /Reshape_125_output_0 Fuse Attention as /Reshape_134_output_0 Fuse Attention as /Reshape_143_output_0 Fuse Attention as /Reshape_152_output_0 Fuse Attention as /Reshape_161_output_0 Fuse Attention as /Reshape_170_output_0 Fuse Attention as /Reshape_179_output_0 Fuse Attention as /Reshape_188_output_0 Fuse Attention as /Reshape_197_output_0 Fuse Attention as /Reshape_206_output_0 Fuse Attention as /Reshape_215_output_0 Fuse Attention as /Reshape_224_output_0 Fuse Attention as /Reshape_233_output_0 Fuse Attention as /Reshape_242_output_0 Fuse Attention as /Reshape_251_output_0 Remove past KV for presents [08:06:28] :174: These Op Not Support: ONNX::FakeLinear Converted Failed!

[FranzKafkaYu]

同样的问题：

 llmexport --path ./Qwen2-0.5B-Instruct --export mnn --quant_bit 4 --quant_block 128 --dst_path output
✅ Done load pretrained model ./Qwen2-0.5B-Instruct                     [ 0.82 s]
✅ Done export tokenizer to output/tokenizer.txt                        [ 0.12 s]
✅ Done export config to output/llm_config.json                         [ 0.00 s]
✅ Done export embedding to output/embeddings_bf16.bin                  [ 0.12 s]
✅ Done export onnx model to output/llm.onnx                            [ 2.32 s]
✅ Done slim the graph of output/llm.onnx                               [ 2.10 s]
⠋ convert onnx model to 
A module that was compiled using NumPy 1.x cannot be run in
NumPy 2.1.0 as it may crash. To support both 1.x and 2.x
versions of NumPy, modules must be compiled with NumPy 2.0.
Some module may need to rebuild instead e.g. with 'pybind11>=2.12'.

If you are a user of the module, the easiest solution will be to
downgrade to 'numpy<2' or try to upgrade the affected module.
We expect that some modules will need time to support NumPy 2.

Traceback (most recent call last):  File "/home/franzkafka/.local/bin/llmexport", line 8, in <module>
    sys.exit(main())
  File "/home/franzkafka/.local/lib/python3.10/site-packages/llmexport/llmexport.py", line 1701, in main
    llm_exporter.export(args.export)
  File "/home/franzkafka/.local/lib/python3.10/site-packages/llmexport/llmexport.py", line 1345, in export
    MNNConveter(onnx_model, self.unloaded_ops, self).export()
  File "/home/franzkafka/.local/lib/python3.10/site-packages/llmexport/llmexport.py", line 455, in export
    MNNConveter.onnx2mnn(self.onnx_model_path, self.mnn_model_path)
  File "/home/franzkafka/.local/lib/python3.10/site-packages/llmexport/llmexport.py", line 37, in wrapper
    result = func(*args, **kwargs)
  File "/home/franzkafka/.local/lib/python3.10/site-packages/llmexport/llmexport.py", line 413, in onnx2mnn
    MNNConveter.convert(convert_args)
  File "/home/franzkafka/.local/lib/python3.10/site-packages/llmexport/llmexport.py", line 391, in convert
    from MNN.tools import mnnconvert
  File "/home/franzkafka/.local/lib/python3.10/site-packages/MNN/__init__.py", line 4, in <module>
    from _mnncengine import *
💥 Failed convert onnx model to 
[Errno 2] No such file or directory: 'output/llm.mnn'  

Python环境：

Python 3.10.12  

原始模型来源于huggingface：https://huggingface.co/Qwen/Qwen2-0.5B-Instruct

[FranzKafkaYu]

同样的问题：

 llmexport --path ./Qwen2-0.5B-Instruct --export mnn --quant_bit 4 --quant_block 128 --dst_path output
✅ Done load pretrained model ./Qwen2-0.5B-Instruct                     [ 0.82 s]
✅ Done export tokenizer to output/tokenizer.txt                        [ 0.12 s]
✅ Done export config to output/llm_config.json                         [ 0.00 s]
✅ Done export embedding to output/embeddings_bf16.bin                  [ 0.12 s]
✅ Done export onnx model to output/llm.onnx                            [ 2.32 s]
✅ Done slim the graph of output/llm.onnx                               [ 2.10 s]
⠋ convert onnx model to 
A module that was compiled using NumPy 1.x cannot be run in
NumPy 2.1.0 as it may crash. To support both 1.x and 2.x
versions of NumPy, modules must be compiled with NumPy 2.0.
Some module may need to rebuild instead e.g. with 'pybind11>=2.12'.

If you are a user of the module, the easiest solution will be to
downgrade to 'numpy<2' or try to upgrade the affected module.
We expect that some modules will need time to support NumPy 2.

Traceback (most recent call last):  File "/home/franzkafka/.local/bin/llmexport", line 8, in <module>
    sys.exit(main())
  File "/home/franzkafka/.local/lib/python3.10/site-packages/llmexport/llmexport.py", line 1701, in main
    llm_exporter.export(args.export)
  File "/home/franzkafka/.local/lib/python3.10/site-packages/llmexport/llmexport.py", line 1345, in export
    MNNConveter(onnx_model, self.unloaded_ops, self).export()
  File "/home/franzkafka/.local/lib/python3.10/site-packages/llmexport/llmexport.py", line 455, in export
    MNNConveter.onnx2mnn(self.onnx_model_path, self.mnn_model_path)
  File "/home/franzkafka/.local/lib/python3.10/site-packages/llmexport/llmexport.py", line 37, in wrapper
    result = func(*args, **kwargs)
  File "/home/franzkafka/.local/lib/python3.10/site-packages/llmexport/llmexport.py", line 413, in onnx2mnn
    MNNConveter.convert(convert_args)
  File "/home/franzkafka/.local/lib/python3.10/site-packages/llmexport/llmexport.py", line 391, in convert
    from MNN.tools import mnnconvert
  File "/home/franzkafka/.local/lib/python3.10/site-packages/MNN/__init__.py", line 4, in <module>
    from _mnncengine import *
💥 Failed convert onnx model to 
[Errno 2] No such file or directory: 'output/llm.mnn'  

Python环境：

Python 3.10.12  

原始模型来源于huggingface：https://huggingface.co/Qwen/Qwen2-0.5B-Instruct

根据上面日志的提示信息，我对NumPy进行了降级，将其版本降低到了1.26.4，仍然存在上述报错

[FranzKafkaYu]

gemma2-2b同样存在该问题

[Starrylun]

qwen2-0.5b转 mnn 格式的时候，遇到了同样的问题，尝试手动转换也报错了，有解决吗？ 无法将 qwen2-0.5b 的模型成功导出成 https://modelscope.cn/models/zhaode/Qwen2-0.5B-Instruct-MNN/files 中的文件。

[Ma-Dan]

转换代码在转成mnn之前，先需要完整的完成onnx的转换，这里为了处理节省时间转成了FakeLinear暂代的onnx，没有再把weight和FakeLinear转换回来rebuild，暂时这样修改，可以完成转换。 https://github.com/Ma-Dan/llm-export/commit/978363f326b284e95eb07a0324f6ea8e5b807c51