update from Yichi - Githubissues

Zefan-Cai / PyramidKV

The Official Implementation of PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funneling

https://arxiv.org/pdf/2406.02069

MIT License

486 stars 44 forks source link

Closed Zefan-Cai closed 3 months ago