search

CVI-SZU / Linly

Chinese-LLaMA 1&2、Chinese-Falcon 基础模型；ChatFlow中文对话模型；中文OpenLLaMA模型；NLP预训练/指令微调数据集
3.03k stars 235 forks source link

请问，deepspeed 微调时，CPU的内存需要多大？ #126

Open Batmana opened 1 year ago

Batmana commented 1 year ago

机器，暴内存不足.

image

zbj-china commented 11 months ago

300G image