Open Zeyuan-Liu opened 1 month ago
During step 2: reward model fine-tuning, "GPT GENERATED MODIFICATED TRAIN/EVAL DATA" is required as the input. Could you please open-source your modificated data, or tell us the structure of the data file? Thanks a lot for your help!
Sorry for late reply. I can share the json file that I generated. Could you leave the gmail address?
Thanks for your reply! My gmail address is zeyuan.liu01@gmail.com.
During step 2: reward model fine-tuning, "GPT GENERATED MODIFICATED TRAIN/EVAL DATA" is required as the input. Could you please open-source your modificated data, or tell us the structure of the data file? Thanks a lot for your help!