search

datawhalechina / self-llm

《开源大模型食用指南》基于Linux环境快速部署开源大模型，更适合中国宝宝的部署教程
Apache License 2.0
6.14k stars 753 forks source link

Qwen1.5-7B Lora微调报错 #107

Closed JeckerWen closed 3 weeks ago

JeckerWen commented 1 month ago

Qwen1.5-7B Lora微调，报这个错怎么解决啊：ValueError: Target modules {'k_proj', 'gate_proj', 'q_proj', 'down_proj', 'o_proj', 'up_proj', 'v_proj'} not found in the base model.

KMnO4-zx commented 1 month ago

检查一下模型是否加载正确，按理说不应该出现这个报错

JeckerWen commented 3 weeks ago

已经解决了哈 谢谢