search

nlpxucan / WizardLM

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath
9.2k stars 713 forks source link

Model used for generating training data? #21

Open gabriead opened 1 year ago

gabriead commented 1 year ago

Hi guys, what LLM are you using for generating the training data? It is the proprietary ChatGPT 3.5 Turbo right? Have you tried out open-source alternatives for data generation as well? How does the usage of ChatGPT for training data generation affect the use of WizardLLM?

nlpxucan commented 1 year ago

We generated our training data using gpt-3.5-turbo. We did not try other open-source alternatives.