search

intel / xFasterTransformer

Apache License 2.0
270 stars 53 forks source link

Add Continue Batching support for Chatglm2/3 #438

Closed a3213105 closed 1 month ago

pujiang2018 commented 1 month ago

LGTM @abenmao could you pls help to review?