search

MiuLab / Taiwan-LLM

Traditional Mandarin LLMs for Taiwan
https://twllm.com
Apache License 2.0
965 stars 84 forks source link

關於訓練相關資訊請教 #26

Closed ysf888app closed 8 months ago

ysf888app commented 10 months ago

感謝您無私分享！ 想請教是否可分享本模型所使用Pretrain, Finetune訓練的腳本、步驟、環境、時間或注意事項等相關細節資訊。 謝謝！

adamlin120 commented 8 months ago

推薦用 https://github.com/huggingface/trl/blob/main/examples/scripts/sft.py with Deepspeed stage 2

ysf888app commented 8 months ago

感謝:)