Closed TuuSiwei closed 2 months ago
up你好,我最近尝试了下https://github.com/yuanzhoulvpi2017/zero_nlp/tree/main/model_clm 的代码,batch和gradient accumulation已经进行了相应的设置,但是在A100上仍然会报OOM,排查不出原因><
up你好,我最近尝试了下https://github.com/yuanzhoulvpi2017/zero_nlp/tree/main/model_clm 的代码,batch和gradient accumulation已经进行了相应的设置,但是在A100上仍然会报OOM,排查不出原因><