search

nlpxucan / WizardLM

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath
9.06k stars 709 forks source link

Question about WizardCoder-1B-V1.0 #235

Open hgKang02 opened 6 months ago

hgKang02 commented 6 months ago

Hi, I have a question about the WizardCoder model, especially in 1B size. I read the paper about WizardCoder and can see that WizardCoder-15B is fine-tuned from StarCoder 15B. I want to ask whether the 1B model is also fine-tuned from the StarCoder 1B model, or is there other way that the 1B model is built? Thank you for your consideration.

Sincerely, Hangoo Kang.

ChiYeungLaw commented 6 months ago

yes. the 1b-version is from the starcoderbase-1b