baichuan-inc / Baichuan2

A series of large language models developed by Baichuan Intelligent Technology
https://huggingface.co/baichuan-inc
Apache License 2.0
4.08k stars 293 forks source link

13B微调如何提升模型知识记忆能力 #363

Closed K-Alex13 closed 8 months ago

K-Alex13 commented 8 months ago

您好,我用lora微调后发现模型的知识记忆能力不太够,我不知道该怎么提升

baichuan-assistant commented 8 months ago

可以尝试RAG,或者用百川的知识库产品体验一下: https://platform.baichuan-ai.com/knowledge