allenai / open-instruct

Apache License 2.0
1.1k stars 145 forks source link

File Not Found error while running finetune_lora_with_accelerate.sh #94

Closed palash04 closed 7 months ago

palash04 commented 7 months ago

Following file seems to be missing in the entire repo oasst1_data.jsonl Where can I find this file?

hamishivi commented 7 months ago

Hi, if you run scripts/prepare_train_data.sh it should download and prepare the training data and download and create that file. Generally, our training scripts are intended as examples of how to use this repo - feel free to replace that file with a file containing your own training data in the required format (jsonl with fields like our uploaded Tulu mix).