search

nlpxucan / WizardLM

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath
9.27k stars 718 forks source link

Question about WizardCoder-1B-V1.0 #235

Open hgKang02 opened 10 months ago

hgKang02 commented 10 months ago

Hi, I have a question about the WizardCoder model, especially in 1B size. I read the paper about WizardCoder and can see that WizardCoder-15B is fine-tuned from StarCoder 15B. I want to ask whether the 1B model is also fine-tuned from the StarCoder 1B model, or is there other way that the 1B model is built? Thank you for your consideration.

Sincerely, Hangoo Kang.

ChiYeungLaw commented 10 months ago

yes. the 1b-version is from the starcoderbase-1b