search

QwenLM / qwen.cpp

C++ implementation of Qwen-LM
Other
514 stars 42 forks source link

Qwen-7B-Chat WSL GPU Error: ankerl::unordered_dense::map::at(): key not found #29

Open dlutsniper opened 9 months ago

dlutsniper commented 9 months ago

Qwen-14B-Chat is OK, but Qwen-7B-Chat is Error: ankerl::unordered_dense::map::at(): key not found WSL OS: Ubuntu 22.04.3 LTS GPU: NVIDIA T600 Laptop GPU

ankerl::unordered_dense::map::at(): key not found

图片

dlutsniper commented 9 months ago

Script:

pip install tiktoken
pip install einops transformers_stream_generator

python3 qwen_cpp/convert.py -i /mnt/d/dev-llm/models/Qwen/Qwen-14B-Chat -t q4_0 -o qwen14b-ggml.bin
  qwen14b-ggml.bin
    7.42GB
python3 qwen_cpp/convert.py -i /mnt/d/dev-llm/models/Qwen/Qwen-7B-Chat -t q4_0 -o qwen7b-ggml.bin
  qwen7b-ggml.bin
    4.04GB

cmake -B build -DGGML_CUBLAS=ON
cmake --build build -j

./build/bin/main -m qwen14b-ggml.bin --tiktoken /mnt/d/dev-llm/models/Qwen/Qwen-14B-Chat/qwen.tiktoken -i
./build/bin/main -m qwen7b-ggml.bin --tiktoken /mnt/d/dev-llm/models/Qwen/Qwen-7B-Chat/qwen.tiktoken -i
zzzcccxx commented 5 months ago

解决了吗，一样的问题