RoboRate / TuningTitans

MIT License
0 stars 6 forks source link

Modify: 模型訓練資料改為分類資料,訓練模型 #31

Closed SamanthaYu0611 closed 1 year ago

SamanthaYu0611 commented 1 year ago
  1. 訓練資料改為training_data_foodsafety.jsonl,驗證資料為validation_data_foodsafety.jsonl 2. 修正finetuenPrepareData中,資料準備需要加上prompt若有英文最好全為小寫,completion的字串起首為一空格
  2. 修正finetuneModelCreate中,取得已訓練完成模型時,需要同時產出analysis result的csv檔案
  3. 以ada為訓練原形的模型結果分析產出檔案為file-hHXxpLipH6tkzJwPl916NnrM_modelAnalysis.csv

29

issue: 29#issue-1849230907

SamanthaYu0611 commented 1 year ago

已用1500筆訓練資料與150筆驗證資料訓練模型,訓練結果如下

davinci

{
  "created_at": 1691993407,
  "events": [
    {
      "created_at": 1691993407,
      "level": "info",
      "message": "Created fine-tune: ft-bJsyVOAiV3lfmzrUGvPLGSUt",
      "object": "fine-tune-event"
    },
    {
      "created_at": 1691993417,
      "level": "info",
      "message": "Fine-tune costs $52.28",
      "object": "fine-tune-event"
    },
    {
      "created_at": 1691993417,
      "level": "info",
      "message": "Fine-tune enqueued. Queue number: 0",
      "object": "fine-tune-event"
    },
    {
      "created_at": 1691993422,
      "level": "info",
      "message": "Fine-tune started",
      "object": "fine-tune-event"
    },
    {
      "created_at": 1691994352,
      "level": "info",
      "message": "Completed epoch 1/4",
      "object": "fine-tune-event"
    },
    {
      "created_at": 1691996023,
      "level": "info",
      "message": "Completed epoch 3/4",
      "object": "fine-tune-event"
    },
    {
      "created_at": 1691996901,
      "level": "info",
      "message": "Uploaded model: davinci:ft-personal-2023-08-14-07-08-20",
      "object": "fine-tune-event"
    },
    {
      "created_at": 1691996902,
      "level": "info",
      "message": "Uploaded result file: file-EXTidOJlDHtTq31AT5p7Vpoo",
      "object": "fine-tune-event"
    },
    {
      "created_at": 1691996905,
      "level": "info",
      "message": "Fine-tune succeeded",
      "object": "fine-tune-event"
    }
  ],
  "fine_tuned_model": "davinci:ft-personal-2023-08-14-07-08-20",
  "hyperparams": {
    "batch_size": 2,
    "learning_rate_multiplier": 0.1,
    "n_epochs": 4,
    "prompt_loss_weight": 0.01
  },
  "id": "ft-bJsyVOAiV3lfmzrUGvPLGSUt",
  "model": "davinci",
  "object": "fine-tune",
  "organization_id": "org-IvId3dAhb1Aw4yaRNv8NT3sh",
  "result_files": [
    {
      "bytes": 156876,
      "created_at": 1691996902,
      "filename": "compiled_results.csv",
      "id": "file-EXTidOJlDHtTq31AT5p7Vpoo",
      "object": "file",
      "purpose": "fine-tune-results",
      "status": "processed",
      "status_details": null
    }
  ],
  "status": "succeeded",
  "training_files": [
    {
      "bytes": 646061,
      "created_at": 1691992923,
      "filename": "file",
      "id": "file-LKx2K5qrFd2B1DCFRTtIaClG",
      "object": "file",
      "purpose": "fine-tune",
      "status": "processed",
      "status_details": null
    }
  ],
  "updated_at": 1691996906,
  "validation_files": [
    {
      "bytes": 53495,
      "created_at": 1691992926,
      "filename": "file",
      "id": "file-cGtWptqaZNToz65YHvuGCm7S",
      "object": "file",
      "purpose": "fine-tune",
      "status": "processed",
      "status_details": null
    }
  ]
}