how to start Instruct finetune by MiniCPM？

OpenBMB / MiniCPM

MiniCPM3-4B: An edge-side LLM that surpasses GPT-3.5-Turbo.

Apache License 2.0

7.11k stars 452 forks source link

how to start Instruct finetune by MiniCPM？ #167

Closed scalaboy closed 3 months ago

scalaboy commented 4 months ago

Feature request / 功能建议

In the finetune dir,the pipeline is train Q-A dataset, however,we need to finetune MiniCPM by Instruct tuning. Is there any solutions?

LDLINGLINGLING commented 4 months ago

I think what we provide is a training method, which is sft. It should also be suitable for instruct tuning. If you have any questions, you can send us your data example.