intel / llm-on-ray

Pretrain, finetune and serve LLMs on Intel platforms with Ray
Apache License 2.0
103 stars 30 forks source link

[Finetune] Resolve the exception caused by missing validation data and the missing gaudi_config parameter in GaudiTrainer. #227

Closed minmingzhu closed 5 months ago

minmingzhu commented 6 months ago
  1. add gaudi_config. When using Gaudi, it will be load gaudi_config.json. One is to download from huggingface with gaudi_config_name and the other is to create new.

image

  1. fix validation dataset to be None
xwu99 commented 6 months ago

@minmingzhu could you specifically write a clear title for what issue you are fixing?

minmingzhu commented 6 months ago

@xwu99 Resolved