Re-Finetune llama2 - Githubissues

OpenFn / apollo

GNU Lesser General Public License v2.1

0 stars 2 forks source link

Re-Finetune llama2 #26

Closed ismailousa closed 11 months ago

ismailousa commented 11 months ago

Remarks Initial checkpoints generates a lot of random text to be considered proper code. This issue aims to address it

Requirements

Update signature generator to match Adaptor.d.ts format
Add parameter and return objects to signature JSDoc
Remove non rest api functions from dataset
Multiply data (too little data initially)
run peft then supervised finetuning