issues
search
SafeAILab
/
EAGLE
Official Implementation of EAGLE-1 (ICML'24) and EAGLE-2 (EMNLP'24)
https://arxiv.org/pdf/2406.16858
Apache License 2.0
780
stars
79
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Can EAGLE actually improve throughput?
#36
chenzhengda
closed
7 months ago
1
Head accuracy
#34
qspang
opened
8 months ago
0
A simple question regarding to the paper.
#32
w32zhong
closed
8 months ago
1
Release Mixtral Training Code
#31
tjtanaa
closed
7 months ago
4
Question about manual datasets & Some interests about details
#30
HackGiter
closed
7 months ago
1
Update README.md
#29
eltociear
closed
8 months ago
1
add .gitignore
#28
UranusSeven
closed
8 months ago
2
About reproduction baseline results
#27
dydrkfl06
closed
8 months ago
2
7B config
#26
zankner
closed
7 months ago
3
failed to reproduce given speedup results
#25
ZepinLi
closed
8 months ago
2
Code Documentation
#24
AndreSlavescu
closed
8 months ago
0
runtime
#23
qspang
closed
7 months ago
9
Small Typo in Blog
#22
AndreSlavescu
closed
8 months ago
1
No pytorch.bin is generated after training is done
#21
tjtanaa
closed
8 months ago
2
Is the rejection and adjusting probability implementation different from normal speculative sampling?
#20
AlvL1225
closed
8 months ago
1
Weired Runtime Error during Inference
#19
nss-programmer
closed
8 months ago
2
OSError when download weights from huggingface
#18
ZepinLi
closed
9 months ago
3
Eagle head accuracy
#17
zankner
closed
8 months ago
6
Support Chinese Task
#16
Ishiki-Iroha
closed
9 months ago
1
Support Chinese-LLaMA-Alpaca-2?
#15
skykiseki
closed
9 months ago
3
train configuration
#14
je1lee
closed
9 months ago
1
CUDA out of memory
#13
pengfeiwu1999
closed
8 months ago
1
RuntimeError: indices should be either on cpu or on the same device as the indexed tensor (cuda:7)
#12
Ishiki-Iroha
closed
9 months ago
2
RuntimeError (porting inference on kaggle)
#11
rkuo2000
closed
9 months ago
1
combinable with vllm
#10
jiangix-paper
closed
9 months ago
3
Can I change the choices tree as I want??
#9
je1lee
closed
9 months ago
5
fix typo
#8
wejoncy
closed
9 months ago
0
支持其他大语言模型吗
#7
fryng
closed
9 months ago
1
The number of candidate nodes and the maximum prediction length setting problem in the candidate tree
#6
shifeiwen
closed
9 months ago
4
Can I get a test setting??
#5
je1lee
closed
9 months ago
8
ValueError: not enough values to unpack (expected 2, got 1)
#4
EnterpriseBCMe
closed
9 months ago
2
OpenAI-like API server
#3
tranhoangnguyen03
closed
9 months ago
1
Difference between Eagle and SpecInfer
#2
Hsword
closed
9 months ago
2
So how many GPUs do you use for inference 33B model?
#1
YixinSong-e
closed
9 months ago
1
Previous