How much data is used for fine tuning?

danielgross / LlamaAcademy

A school for camelids

MIT License

1.21k stars 77 forks source link

Closed hengjiUSTC closed 1 year ago

hengjiUSTC commented 1 year ago

Hope to know, after instruction generation process, how much instructions is generated to finetune Vincua?

huyphan168 commented 1 year ago

The config file recommends at least 200 examples. Personally, I think you should generate data as much as possible for high quality generation.

hengjiUSTC commented 1 year ago

Oh crazy! I thought finetuning need something close to 2-3k to be useful before.