SafeAILab EAGLE issues - Githubissues

SafeAILab / EAGLE

Official Implementation of EAGLE-1 (ICML'24) and EAGLE-2 (EMNLP'24)

https://arxiv.org/pdf/2406.16858

Apache License 2.0

780 stars 79 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Would like to see base models

#86 rombodawg opened 3 months ago
0
Are you going to support Gemma-2?

#85 jumasheff opened 3 months ago
0
have you guys tried other speculative draft model with eagle-2 method?

#84 hanlinxuy opened 3 months ago
0
when eagle-2 will be opensourced?

#83 hanlinxuy closed 3 months ago
1
Question about past_key_value modification

#82 baihuajun24 opened 3 months ago
2
I use Chinese and English mixed dataset and a another custom 7B model to train eagle，but the performance in Chinese is not good enough

#81 2024WY closed 1 month ago
1
Question about alpha

#80 zkqq closed 2 months ago
3
reproducing eagle on mistral-7b-v0.3-instruct

#79 alcholiclg opened 3 months ago
6
Is there a guide to Train eagle heads on custom models?

#78 cryoco closed 2 months ago
4
Why does instruction_len need to subtract 2?

#77 cdliang11 closed 3 months ago
2
Why does EAGLE remove the input_layernorm of llama?

#76 bisunny opened 4 months ago
2
Quality loss in greedy mode.

#75 w32zhong closed 4 months ago
6
Question about sampling

#74 Monoclinic closed 3 months ago
6
Using EAGLE will slow down inference

#73 zkqq closed 2 months ago
7
During training, only one decoder layer(draft model) is trained, right?

#72 CRH400AF-A closed 4 months ago
1
Updates on training moe eagle model?

#71 cyLi-Tiger opened 4 months ago
0
difference between the target input_ids and original LLMs in function getkacc()

#70 kafkayu opened 4 months ago
0
bug fix: hidden_states nan

#69 dtlzhuangz closed 4 months ago
1
The initiization of tree_buffers

#68 kafkayu closed 4 months ago
0
Llama 3 support?

#67 joshmackwilliams closed 3 months ago
3
new model

#66 shunxing12345 opened 5 months ago
6
About reproducing speedup ratio

#65 hyomin14 closed 2 months ago
1
training efficiency

#64 pengfeiwu1999 closed 1 month ago
1
Qs on self.act

#63 cyLi-Tiger closed 5 months ago
1
Is there scripts to calculate the overall acceptance rate?

#62 sugar1946 opened 5 months ago
3
About KVCache of Eagle vs Origin LLM

#61 jcao-ai closed 5 months ago
0
Questions about the EAGLE parameters, not match the pytorch_model.bin

#60 DeclK closed 5 months ago
2
Questions about pre-allocated kv_cache.

#59 Hevans123 closed 5 months ago
1
Question on draft process

#58 cyLi-Tiger closed 6 months ago
1
About project structure

#57 zsnoob closed 5 months ago
1
run with vllm

#56 Hevans123 closed 6 months ago
1
How to support new model?

#55 wanghuihhh closed 5 months ago
1
bsne1 branch "last_hidden = out_hidden[ab,last_nopadding][:,None]" gets wrong

#54 lihuahua123 closed 5 months ago
4
About tree_buffer

#53 reflectionie closed 6 months ago
2
VLLM contribution

#52 arunpatala closed 6 months ago
2
can you share ShareGPT dataset used to train the models?

#51 arunpatala closed 6 months ago
3
Generation quality loss

#50 cyLi-Tiger closed 6 months ago
7
Can Eagle improve the inference throughput in continuous batch mode?

#49 xiongqisong closed 6 months ago
4
Inference on the CPU, the speed improvement is limited

#48 tigerliu10 closed 5 months ago
2
fix: update verify process

#47 cyLi-Tiger closed 7 months ago
1
How many decoder layer needs to add in EAGLE?

#46 yjdy closed 5 months ago
5
RuntimeError: probability tensor contains either `inf`, `nan` or element < 0

#45 cyLi-Tiger closed 7 months ago
5
vicuna 7b oom

#44 yjdy closed 7 months ago
1
Support vLLM

#43 ruidongtd closed 1 month ago
2
Data processing script (ge_data/allocation.py) script does not work out of the box

#42 avnermay opened 7 months ago
1
Can EAGLE be applied to any auto-regressive model?

#41 sam-sepiola closed 5 months ago
3
fix typo in README.md

#40 sonald closed 7 months ago
0
Is there scripts to calculate the acceptance rate at each position?

#39 agentup closed 7 months ago
1
How to train LLama-70B eagle?

#38 YixinSong-e closed 6 months ago
4
KV Cache initialization throwing an error

#37 haim-barad closed 7 months ago
8

Previous Next