search

brightmart / albert_zh

A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型
https://arxiv.org/pdf/1909.11942.pdf
3.92k stars 755 forks source link

albert_Tiny文本分类推理速度CPU 300+ms，GPU 7ms，请问正常么 #153

Open faker2cumtb opened 3 years ago

faker2cumtb commented 3 years ago

albert_tiny后面只接了一层线性分类层[312*6]，CPU下推理速度300+ms，GPU下7ms，想问下正常CPU推理速度大概在多少ms。 CPU下运行 image GPU下运行 image