search

sunzeyeah / RLHF

Implementation of Chinese ChatGPT
282 stars 36 forks source link

deepspeed速度 #6

Closed superqing001 closed 1 year ago

superqing001 commented 1 year ago

请问下，为什么deepspeed多(8)卡对单卡的训练速度反而更慢？