bytedance / lightseq

LightSeq: A High Performance Library for Sequence Processing and Generation
Other
3.21k stars 329 forks source link

GPU speedup vs CTranslate2 #469

Open nghuyong opened 1 year ago

nghuyong commented 1 year ago

Could you provide the benchmark of the comparison of lightseq and OpenNMT/CTranslate2 on some basic models, such as BART, T5. Thanks a lot.