Tongjilibo / bert4torch

An elegent pytorch implement of transformers
https://bert4torch.readthedocs.io/
MIT License
1.22k stars 152 forks source link

询问一个bert4torch和bert4keras的差异 #145

Closed pql123 closed 1 year ago

pql123 commented 1 year ago

我在使用bert4keras加载 bert-base-chinese,做分类任务时,会查出显存,但是使用bert4torch就可以正常训练,是torch显存优化的比tensorflow好?还是bert4torch会冻结某些参数嘛?我的显卡是1660 6g显存。

基本信息

Tongjilibo commented 1 year ago

bert4torch不会冻结参数,至于你说的显存问题,基于以上我目前也判别不出来