launch gpt embedding with float4 - Githubissues

bytedance / lightseq

LightSeq: A High Performance Library for Sequence Processing and Generation

Other

3.22k stars 329 forks source link

launch gpt embedding with float4 #489

Closed hexisyztem closed 1 year ago