search

nlpxucan / WizardLM

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath
9.25k stars 716 forks source link

Codebase Evol-Instruct Training/Fine-Tuning #77

Open kenfink opened 1 year ago

kenfink commented 1 year ago

Is there is an Evol-Instruct method that could build a training dataset from a specific codebase?

An ideal end-goal would be a script to generate a training dataset for a WizardCoder LoRA based on a local folder that contains codebases of intended dependencies so that WizardCoder can write code to utilize that code.

maxilie commented 1 year ago

Is there is an Evol-Instruct method that could build a training dataset from a specific codebase?

An ideal end-goal would be a script to generate a training dataset for a WizardCoder LoRA based on a local folder that contains codebases of intended dependencies so that WizardCoder can write code to utilize that code.

I can’t seem to find the code for the evol-instruct method anywhere on the internet. Many of us would be very grateful for its release. Please.