DataTerminatorX / Keyword-BERT

279 stars 55 forks source link

性能问题 #7

Open jieli4970 opened 4 years ago

jieli4970 commented 4 years ago

您好,您用6layer的并发支持好吗?我是用tf serving来落地的,但是并发一般呀。感谢回复

DataTerminatorX commented 4 years ago

serving的并发和模型关系不大,和框架有关。你可以试试nvidia的transformer加速模块

jieli4970 commented 4 years ago

感谢。