search

intel / xFasterTransformer

Apache License 2.0
322 stars 56 forks source link

[Common] New KVCacheMgr to support CB #371

Closed pujiang2018 closed 2 months ago

pujiang2018 commented 2 months ago

@Duyi-Wang @abenmao @changqi1 Pls take time to review this.