search

THUNLP-MT / THUMT

An open-source neural machine translation toolkit developed by Tsinghua Natural Language Processing Group
BSD 3-Clause "New" or "Revised" License
701 stars 197 forks source link

batch_size 10G GPU 单机最大能做到多少 #89

Open caoyuji1986 opened 4 years ago

Playinf commented 4 years ago

这个值取决于模型大小以及GPU是否支持半精度。可以先设置一个值，然后观察训练时是否出现OOM，如有则继续调小。