MiniCPM-V-2 运行出错

modelscope / swift

ms-swift: Use PEFT or Full-parameter to finetune 250+ LLMs or 35+ MLLMs. (Qwen2, GLM4, Internlm2, Yi, Llama3, Llava, MiniCPM-V, Deepseek, Baichuan2, Gemma2, Phi3-Vision, ...)

https://github.com/modelscope/swift/blob/main/docs/source/LLM/index.md

Apache License 2.0

2.13k stars 205 forks source link

MiniCPM-V-2 运行出错 #1218

Closed Li-Lai closed 4 days ago

Li-Lai commented 4 days ago

Describe the bug 参考MiniCPM-V-2 最佳实践，运行：CUDA_VISIBLE_DEVICES=0 swift infer --model_type minicpm-v-v2-chat 提示如下错误： RuntimeError: probability tensor contains either inf, nan or element < 0

Your hardware and system info NVIDIA-SMI 550.54.14 Driver Version: 550.54.14 CUDA Version: 12.4 transformers 4.37.2 torch 2.2.2 swift 是昨天下载编译的版本

Jintao-Huang commented 4 days ago

--dtype bf16呢

Li-Lai commented 4 days ago

可以，谢谢！