RoboRate / TuningTitans

MIT License
0 stars 6 forks source link

feat: benchmark(2) 確認Context Injection+模組化benchmark code #16

Closed FernandeChant closed 1 year ago

FernandeChant commented 1 year ago
  1. 'Validation'得到的complied_result.csv,相較僅有fine-tuning的結果,多了這三個欄位:validation_loss,validation_sequence_accuracy,validation_token_accuracy。
  2. 測試Context Injection如何執行。
  3. 將benchmark的code模組化。
FernandeChant commented 1 year ago

@yillkid

openai.FineTune.create(
     training_file= training_file_id,
     validation_file = validation_file_id,
     model="davinci:ft-personal:test1-2023-08-03-11-55-27",
     suffix="validation_model"
 )

請問context injection是不是相當於traning_file? 如果是的話, context injection是不是可以再次拿fine-tuning同樣的dataset?