issues
search
AnswerDotAI
/
cold-compress
Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of GPT-Fast, a simple, PyTorch-native generation codebase.
https://www.answer.ai/posts/2024-08-01-cold-compress.html
BSD 3-Clause "New" or "Revised" License
85
stars
8
forks
source link
Implement ThinK
#36
Open
griff4692
opened
2 months ago
griff4692
commented
2 months ago
https://arxiv.org/abs/2407.21018
https://arxiv.org/abs/2407.21018