issues
search
Zefan-Cai
/
PyramidKV
The Official Implementation of PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funneling
https://arxiv.org/pdf/2406.02069
MIT License
486
stars
44
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
请问如何消除整除带来的误差?
#22
CN-LWZ
opened
1 week ago
2
Bug Report
#21
Patrick-Ni
opened
1 month ago
3
请问 kv_cluster.update_kv 只在 prefill 时被调用吗?
#20
DOG-wooooof
opened
2 months ago
3
对比了下StreamingLLM源码实现,貌似PyramidKV中的实现位置编码这块有问题
#19
free-stardust
opened
2 months ago
4
仅截取了输入数据的前4k和后4k token, 但longbench最长32k token?
#18
JulietLJY
opened
2 months ago
1
判断条件的依据
#17
exectrl
opened
2 months ago
3
Settings and implementations of baselines
#16
bingps
opened
2 months ago
3
A serious issue in your code
#15
JulietLJY
opened
3 months ago
6
Merge into vLLM, is it possible?
#14
PatchouliTIS
opened
3 months ago
4
Strange Results of Mistral
#13
yuhuixu1993
closed
2 months ago
1
Question about evaluating Llama-3-8B-Instruct on LongBench
#12
jameslahm
closed
3 months ago
8
Mistral 7B full kv cache out of memory
#11
monster119120
closed
3 months ago
6
question about case selection in observations
#10
Cooperx521
opened
3 months ago
1
mistral7B运行错误
#9
monster119120
closed
3 months ago
2
Llama3-8B model url
#8
monster119120
closed
3 months ago
8
correct transformers version
#7
monster119120
closed
3 months ago
1
confused about some code
#6
bohr
closed
3 months ago
3
Congratulation on the great work & hope for future versions
#5
doptime
opened
3 months ago
2
What prompt was used in Needle in a Haystack test?
#4
66RING
closed
3 months ago
4
Revert "Update requirements.txt"
#3
Zefan-Cai
closed
3 months ago
0
Update requirements.txt
#2
zhongmz
closed
3 months ago
0
update from Yichi
#1
Zefan-Cai
closed
3 months ago
0