ZhuiyiTechnology / simbert

a bert for retrieval and generation
Apache License 2.0
840 stars 152 forks source link

该模型的显存占用高达78G?能否优化? #36

Open AWangji opened 5 months ago

AWangji commented 5 months ago

我在A100上跑该项目,结果发现在单张卡上显存占用达到了78G,这个占用太高了,能否优化? image