search

beyondguo / LLM-Tuning

Tuning LLMs with no tears💦; Sample Design Engineering (SDE) for more efficient downstream-tuning.
956 stars 98 forks source link

6块Tesla A100 40G训练会卡住 #35

Closed cherishtttz closed 1 year ago

cherishtttz commented 1 year ago

请问finetune对显存有要求吗？用了6块A100 40G的卡，训练3万多条数据的时候会卡住。

beyondguo commented 1 year ago

提供完整信息再reopen