search

SafeAILab / EAGLE

Official Implementation of EAGLE-1 (ICML'24) and EAGLE-2 (EMNLP'24)
https://arxiv.org/pdf/2406.16858
Apache License 2.0
825 stars 81 forks source link

Is there a script to calculate the average acceptance length? #160

Open Lyn-Lucy opened 5 hours ago

Lyn-Lucy commented 5 hours ago

Hi, thanks for you great work! When I used the EAGLE-llama2-chat-7B you provided for testing, the average acceptance length I measured was lower than the value in the paper. The way I obtained it was to get all the accept_lengths and divide them by the total number of inferences, and finally add 1, which is the token of the last sample of the large model.

hongyanz commented 4 hours ago

You may refer to the link below.

https://github.com/SafeAILab/EAGLE/issues/153#issuecomment-2454707075